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The  recommendation  of  an  early  study  program  was  to  examine  the  possi- 
bility of  electrically  reprogrammable  analog  weights  at  tap  positions  along  a 
CCD  analog  delay  line  in  order  to  form  a basic  linear  combiner  for  adaptive 
filtering.  A step  was  taken  in  this  direction  with  the  development  of  a serial 
in/parallel  out  (SI/PO)  CCD  with  a floating  clock  electrode  circuit  for  the 
attachment  of  conductance  weights.  3 The  latter  circuit  combined  the  advan- 

4 

tages  of  MOS  and  bipolar  technologies  to  sense  nondestructively  the  signal 
charge  under  a floating  gate  electrode  in  'he  form  of  a displacement  charge 
stored  on  a MOS  transistor  amplifier.  The  idea  of  electrically  reprogram- 
mable analog  conductances  with  MNOS  memory  transistors  biased  in  their 


' M.  H.  White  and  W.  R.  Webb,  ' Study  of  the  Use  of  Cha  rge  - Coupled  Devices 
in  Analog  Signal  Processing  Systems,'  Final  Report,  N00014-74-C-0069, 

May  1974. 

2M.  H.  White,  I.  A.  Mack,  F.  J.  Kub,  and  D.  R.  Lampe,  " Cha  rge -Coupled 
Device  Analog  Signal  Processing,  Final  Report  N00014-75-C-0283,  Feb. 
1976. 

3\1.  H.  White,  I.  A.  Mack,  F.  J.  Kub,  D.  R.  Lampe  and  J.  L.  Fagan,  ' An  Ana- 
log CCD  Transversal  Filter  with  Floating  Clock  Electrode  Sensor  and  Varia- 
ble Top  Gains,  " ISSCC_Technical^  pg.  194,  Philadelphia,  Pa. 

4F.  J.  Kub,  M.  H.  White,  D.  R.  Lampe,  J.  L.  Fagan  and  I.  A.  Mack,  ' CCD/ 
Dipolar  Monolithic  1C  Technology,"  Abstract  #107,  pg  207.  Extended  Ab- 
stracts, Vol.  76-1.  Spring  Meeting,  Electrochemical  Society,  May  2-7,  1976, 
(Washington,  D.  C.  1. 

I.  A.  Mack,  M.  II.  White,  F.  J.  Kub,  D.  R.  Lampe,  and  J.  L.  Fagan,  "A 
Versatile  CCD  Analog  Transversal  Filter  with  Floating  Clock  Electrode 
Sensors'  NAECON  76  (Dayton,  Ohio,  May  1976). 
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^riode  regions  was  discussed  in  Hie  literature  ’ with  the  indention  of  adaptive 

filter  based  on  the  least  mean  square  (I. MS)  error  algorithm  to  optimize 

MX  OS  analog  conductance  tap  weights. 

Early  in  this  program  a decision  had  to  be  made  with  regards  to  the  <ype 

of  analog  weighting,  since  the  option  existed  between  conventional  MOS  triode 

9 

multipliers  with  capacitor  storage  and  electrically  reprogrammable  MX  OS 
♦ riode  multipliers  which  used  direct  tunneling  through  thin  oxide  (20  to  30A) 
layers.  * In  order  to  implement  the  LMS  algorithm,  the  multiplier  or  weight 
had  to  be  adjustable  and  some  technique  of  integration  or  storage  was  re- 
quired. Since  storage  times  of  several  minutes  we  . e anticipated  for  some 
applications,  this  meant  either  large  "off-chip'-  capacitors  for  the  MOS 
multipliers  or  the  inherent  "memory"  of  Hie  MX  OS  multipliers.  We  had 
worked  with  MXOS  devices  for  over  a decade,  starting  in  1965,  and  this  ex- 

12 

perience  combined  with  the  long-term  endurance  of  these  devices  to  cycling 


M.  II.  White,  D.  R.  I.ampe,  J.  I..  Fagan,  CCD  k-  MXOS  Devices  for  Pro- 
grammable Analog  Signal  Processing  and  Digital  Xonvolatile  Memory,  - 
IEDM  Technical  Digest,  (Dec.  1973)  pg.  130-3. 

' D.  R.  Lampe,  M.  II.  White,  J.  1 1.  Mims,  and  G.  A.  Gilmour,  "CCD's  for 
Discrete  Analog  Signal  Processing  (DASP),  " IXTER<  OX  74,  f Xew  York, 

March  1974). 

13.  W id  row,  "Adaptive  Filters  I:  Fundamentals,'  Kept.  SEL-66-126  (I.R. 

Xo.  6764-6)  Stanford  Electronics  Labs.,  (Stanford,  Calif.,  Dec.  1966). 

D.  R.  Lampe,  H.  C.  Lin,  I.  A.  Mack,  M.  II.  White,  " CMOS  Analog  Multiplie rs 
for  CCD  Analog  Signal  Processing"  1976  GO  MAC  Digest  of  Papers. 

I " M.  H.  White  and  J.  R.  Cricchi,  "Characterization  of  Thin-Oxide  MXOS  Mem- 

ory Transistors'  , IEEE  Trans.  Electron  Devices,  E 1 ) - 1 ' 1 , 1280  (1972). 

I I M.  M.  Sondhi  and  A.  J.  Presti,  "A  Self-Adaptive  Echo  Canceller,"  IX  S.  T.  .1 . , 
1851  (1966). 

1 2 

M.  II.  White,  J.  W.  Dzimianski,  and  M.  C.  Peckerar,  "Endurance  of  Thin- 
Oxide  Xonvolatile  MXOS  Memory  Transistors,-  IEEE  I runs.  Electron 
Devices,  ED -24,  577  (1977). 
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made  the  MNOS  memory  transistor  a logical  choice  for  the  electrically  re- 
programmable analog  conductance  weight.  In  addition  to  the  storage  or  in- 
♦ eu  ration  requirement,  the  electrical  programmability  function  could  be  im- 
plemented in  a simple  manner  with  the  erase /write  features  of  the  MNOS 
device  structure.  Thus,  this  report  discusses  the  combination  of  CCD  dis- 
crete analog  delay  line  technology  with  thin-oxide  MNOS  memory  technology 
to  form  a basic  linear  combiner  for  adaptive  filtering.  The  CCD/MNOS  tech- 
nologies have  been  used  already  in  a monolithic  cha rge -add res sed  memory 
I 3 

cell  and,  therefore,  the  results  presented  in  this  report  are  extendable  to 
a complete  monolithic  adaptive  filter  integrated  circuit.  In  the  latter  phases 
of  the  program,  a bidirectional  CCD  control  technique  was  developed  to  obtain 
analog  weighting.  This  method  offers  an  "all  CCD"  adaptive  filter  and  is 
discussed  in  this  report. 

This  report  begins  with  an  introduction  to  adaptive  filtering  followed  by 
the  LMS  algorithm  to  optimize  the  selection  of  tap  weights  in  the  filter.  The 
filter  is  comprised  of  a basic  linear  combiner,  which  consists  of  a CCD  dis- 
crete analog  delay  line  with  electrically  reprogrammable  MNOS  analog  con- 
ductance tap  weights  to  weight  the  nondestructively  sensed  signals  in  the 
delay  line,  and  an  algorithm  to  control  the  programming  of  the  tap  weights. 

In  addition,  signal  condition  and  reconstruction  circuitry  together  with  anti- 
aliasing filters  are  employed  to  generate  the  appropriate  analog  waveforms. 
To  demonstrate  the  feasibility  of  the  approach,  a 2-tap  weight  adaptive  filter 
breadboard  is  described.  Such  a configuration  represents  the  basic  adaptwe 
filter  element  in  a multitap  weight  adaptive  filter.  Preliminary  evaluation  of 
this  basic  adaptive  filter  element  indicates  this  approach  should  open-the- 
door  to  the  realization  of  low-cost,  compact,  adaptive  systems  for  such  ap- 
plications as  filtering,  prediction,  system  modeling,  spectral  analysis,  noise 


M.  H.  White,  D.  R.  Lampe,  .T.  L.  Fagen,  F.  J.  Kub,  and  D.  A.  Barth,  "A 
Nonvolatile  Charge  Addressed  Memory  (NOVCAM)  Cell,"  IEEE  J.  of  Sol  id - 
State  Ckts,  SC-10,  281  (1975). 
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suppressions,  echo  cancellation,  etc.  Specific  systems  which  would  benefit 

from  such  an  adaptive  filter  are  secure  speech  processing  with  adaptive  linear 

14  . 15 

prediction  , sonar  beam  forming  with  adaptive  sidelobe  clutter  cancellers, 

16 

and  adaptive  noise  cancellers  for  sensor-oriented  systems. 


1 4 

D.  F.  Barbe,  "The  Use  of  Charge-Coupled  Devices  in  Voice  Processing 
Systems,  " 1977  LUFF  International  Symposium  on  Circuits  and  Systems. 
Phoenix,  Arizona,  April  25,  1977. 

15M.H.  White,  K.  Petrosky,  I.  A.  Mack,  I..  1.  Lewis,  "Adaptive  CCD  Signal 
Processing  for  Sonar  Applications,"  1977  International  Symposium  on  Cir- 
cuits and  Systems,  Phoenix,  Arizona,  April  25,  1977. 

^ B.  Widrow,  et.al.  , "Adaptive  Noise  Cancelling;  Principles  and  Applications, 
Proc.  1KKE,  63,  1692  (1975). 
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2.  INTRODUCTION’  TO  ADAPTIVE  SIGNAL  PROCESSING 


The  history  of  adaptive  signal  processing  might  well  begin  with  the  intro- 

IT  18 

duction  of  least  squares  estimation  theory  by  Gauss  and  Legendre 

Gauss  introduced  this  technique  to  solve  a large  number  of  redundant  equations 

to  extract  the  "most  probable  values"  of  certain  astronomical  parameters. 

19 

Modern  adaptive  filter  theory  began  with  the  work  of  Kolmogorov  and 
20 

W iener  on  the  prediction  and  filtering  of  stationary  time  series.  Wiener 

treated  continuous  signals  while  Kolmogorov  examined  sampled  data  systems, 

thus,  anticipating  the  need  foi  coherent  signal  processing.  The  Wiener/ 

Kolmogorov  work  provided  the  basic  design  criteria  for  optimal  linear  filters 

to  suppress  noise,  perform  signal  prediction,  and  smooth  statistically  sta- 

'ionary  signals.  The  design  of  these  filters  for  known  statistics  is  well  un- 
21 

derstood  . but  practical  considerations  often  place  limits  on  the  implementa- 

22 

'ion  of  such  filters.  Kalman  and  Rucy  extended  the  Kolmogorov  Wiener 


Gauss, 

1963). 


K.  G. 


Theory  of  Motion  of  the  Heavenly  Bodies,  (Dover,  New  York, 


II.  W.  Sorenson,  Least-Squares  Estimation:  from  Gauss  to  Kalman" 

IEEE  Spectrum,  pg.  6 3,  (July  1970). 

» 

A.  Kolmogorov,  ' Tnte  rpolation  und  Extropolation  von  Stationaren  /ufalligen 
Eolgen,  ' Hull  Acad.  Sci,  USSR,  Ser.  Math.,  _5,  3(1941) 

. W iener,  Hie  Extrapolation,  Interpolation  and  Smoothing  of  Stationary 
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techniques  to  consider  the  design  of  time-varying  linear  filters  for  nonsta- 
tionary signals.  In  general,  these  types  of  filters  have  parameters  whose 
values  are  determined  by  apriori  information  on  the  signal  statistics.  The 
so-called  Kalman  filter  represents  essentially  a recursive  solution  of  Gauss' 

original  least-square  problem  in  which  the  computations  benefits  of  todays 

, , 23 

digital  computers  are  used  to  advantage. 

Adaptive  filters  are  a class  of  ' learning  machines"  in  which  the  filter 

design  (weight  or  parameter  adjustments)  is  self-lea rning  and  based  upon 

estimated  (measured)  statistical  characteristics  of  the  input  and  output  signals. 

Adaptive  filtering  based  on  a recursive  algorithm,  (correlation-cancella- 

24 

tion  loop  (C.CL),  ) was  employed  in  the  RF-antenna  field  in  the  1950's. 

Two  groups  working  independently,  developed  techniques  for  adaptive  inter- 
ference or  clutter  cancelling.  One  group  worked  on  radar  IF  sidelobe  clutter 
25 

cancellers  with  optimization  achieved  by  an  algorithm  that  maximized  a 

2 () 

generalized  signal-to-noise  ratio  (SNR).  The  other  group  worked  on  a self- 

optimizing  array  for  control  systems  based  on  sampled  signals  and  a least 

27 

mean  square  (LMS)  error  algorithm.  These  two  adaptive  algorithms, 
although  arrived  at  with  different  approaches  and  different  objectives,  are 
nevertheless  very  similar  since  they  both  derive  their  adaptive  parameter 
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adjustments  by  sensing  the  correlation  between  element  signals.  Thus,  both 
algorithms  use  the  covariance  matrix  of  the  set  of  system  inputs  and  both 
converge  toward  the  optimum  Kolmogorov/Wiener  solution.  In  this  report, 


we  use  the  LMS  adaptive  algorithm  developed  by  Widrow  and  Hoff  at  Stanford 
28 

University  in  1959.  Widrow,  in  a recent  survey  and  tutorial  article  on 

29 

adaptive  noise  cancelling,  describes  the  work  performed  during  the  1960's 
by  he  and  his  colleagues  at  Stanford  University. 

The  adaptive  filter  operates  without  apriori  knowledge  of  the  signal  statis- 
tics and  the  filter  uses  the  available  data  to  design  an  appropriate  filter. 

The  general  form  of  an  adaptive  filter  is  limited  by  practical  considerations 
since  the  inversion  and  storage  of  large  matrices  of  data  requires  a sizeable 

volume  of  computer  space  and  real-time  signal  processing  is  difficult  to  ac- 

28 

complish.  The  iterative  LMS  algorithm  of  Widrow  and  Hoff  requires  very 
little  computer  time  or  memory,  and  the  algorithm  is  suitable  for  real-time 
processing  of  large  amounts  of  data.  With  this  algorithm,  the  statistics  of  the 
signals  are  not  measured  explicitly  to  design  the  filter  but,  instead,  through 
a recursive  algorithm,  the  weight  adjustments  are  made  automatically  with 
the  arrival  of  each  new  data  sample.  In  order  to  appreciate  the  degree  of 
computation  required  in  the  direct  computation  form  of  the  least-square 
estimation  problem,  consider  the  adaptive  filter  shown  in  figure  1.  We  treat 
the  adaptive  system  as  a discrete-time  system  with  the  instantaneous  error 

e d - Y . (1) 

m m m 

where  d is  the  so-called  desired  or  primary  signal  and  Y is  the  filter  out- 
m m 

put.  Suppose  we  can  represent  the  filter  output  as  a weighted  summation  of 
delayed  input  signal  samples. 
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Figure  1.  Adaptive  Transversal  Filter 
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Where  W are  the  adjustable  weights.  The  major  component  of  most  adaptive 

K 

systems  is  the  basic  linear  combiner  which  weights  and  sums  a set  of  input 
signals  to  form  the  output  signal.  The  input  signal  vector  is  defined  as, 
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Where  the  input  signal  components  appear  simultaneously  on  all  tap  positions 
along  the  tapped  delay  line  and  indexed  by  the  time  index  m.  The  weight 
vector  is  given  as, 
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The  error  is, 


e d-X!W  d - W 1 X 

m m m m 
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(5) 


The  desired  signal  generally  requires  some  imagination  and  the  form  of  this 

signal  determines  the  type  of  adaptive  processor.  For  example,  if  d were 

m 
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derived  from  the  input  to  the  adaptive  filter,  then  we  would  have  an  adaptive 
30 

linear  predictor.  A second  selection  of  d is  to  make  this  input  the  signal 
r m 

and  noise  while  the  input  of  the  filter  is  selected  as  the  noise,  thereby  realiz- 

29 

ini'  an  adaptive  noise  canceller. 

The  purpose  of  the  adaptive  algorithm  is  to  adjust  the  weights  of  the  adap- 
tive linear  combiner  to  minimize  the  mean-square  error.  We  may  ask  the 
question  ’ for  which  class  of  signals  is  this  optimization  procedure  justified?1 
There  are  two  broad  classes  of  signals:  deterministic  and  random  signals. 
Within  the  deterministic  class  of  signals  we  have  signals  which  exist  over  an 
infinite  time  interval  and  thus,  autocorrelation  techniques  can  be  applied. 

Similarly,  stationary  ergodic  random  signals  may  be  handled  with  autocorre- 

, . 21  . 

lation  techniques  which  may  be  computed  as  a time  average.  Finite  dura- 
tion dete rministic  signals  may  be  analyzed  with  the  covariance  method  and 

similarly,  nonstationary  signals  that  are  locally  stationary  over  a finite  time 

31 

duration  may  be  handled  with  the  same  method.  We  will  assume  signals 
that  are  statistically  stationary  with  the  knowledge  nonstationa  ry  signals  may 
also  be  handled  with  such  adaptive  filters.  W c begin  with  the  formulation  of 
the  squared  error, 

? ? t T T 

e d - 2d  X W ■)  W X X W (M 

m m m m m m 

and  taking  the  expected  value  of  both  sides. 

E(t~  2 ) E ( d 2 ) - 2PT\V  t W 1 RW  (7) 

\ m / v m ' 
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The  important  feature  of  equation  (7)  is  the  mean  square-error  (MSE)  is  a 
quadratic  function  of  the  weights  or  may  be  considered  as  a concave  hyper- 
buloidal  surface.  The  process  of  weight  adjustment  to  minimize  the  MSE 
involves  descending  along  this  surface  to  reach  the  so-called  "bottom  of  the 
bowl'  . A popular  method  to  descend  along  this  surface  is  the  gradient  tech- 
nique. 

TE  f " ) - 2P  + 2RW  (10) 

V m / 

and  the  optimum  weight  rector,  generally  called  the  Wiener  weight  vector, 
is  obtained  by  setting  the  gradient  equal  to  zero. 


W = R-1P  (ID 

opt. 

which  is  the  matrix  form  of  the  Kolmogo rov / W iene  r-I  lopf  equation.  The 
minimum  MSE  is  obtained  by  substitution  of  (11)  into  (7). 
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The  conventional  approach  used  to  solve  for  the  optimum  weights  involves 
a two-step  process  computing  and  updating  the  sample  covariance  matrix  with 
a block  of  data  and  then  solving  equation  (11).  In  order  to  accomplish  this 

comput ation,  various  numerical  algorithms  have  been  investigated  such  as 

32  33  34 

t riangula rization,  Levison- Robinson,  householde  r/t  ransfo rmation,  and 

35 

Gaussian  elimination.  These  methods,  even  the  most  efficient  one,  require 

36,  37 

a considerable  amount  of  hardware  for  real-time  operation.  ’ The  size 

and  pow'er  dissipation,  not  to  mention  the  cost,  is  a principle  liability  of  the 

so-called  direct  approach  for  solving  equation  (11).  An  alternative  approach 

to  the  elephant-compute  r method  is  to  use  a well-known  recursive  stochastic 

29 

algorithm  known  as  the  LMS  adaptive  algorithm. 
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3.  THE  LMS  ALGORITHM 


The  least-mean  square  (LMS)  algorithm  has  its  roots  in  the  method  of 
steepest  descents.  The  weight  adjustment  is  in  a direction  proportional  to 
the  negative  gradient  of  some  functional  F, 
dW  . 

V ■|1  r w.  F 112 

J 

where  the  gradient  is  taken  with  respect  to  the  weight  vectors  and  p is  the 
so-called  ' convergence''  factor.  In  this  particular  instance,  the  functional 
is  defined  in  terms  of  the  mean-square  error. 

F E ( e2)  = e2  (13 

Since  we  are  concerned  with  discrete-time,  sample-data,  systems  the  dif- 
ference equation  formalism  is  appropriate, 


W.  (m+  1 ) W.  (m)  - pv  € (m) 

J J Wj 

If  we  combine  equation  (14)  with  equation  (11),  then  we  may  write 


W(m  + 1 ) (I-2pR)  W(m)+  2pP 


in  matrix  notation.  Equation  (15)  is  a first  order  difference  equation  which 

3 8 

can  be  used  to  solve  for  the  response  of  the  mean  weight  vector, 


TT(m)  ( I-2pR)nV  + R~ 1 fl-(I- 

o L 


2pR)m  P 
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where  W is  the  initial  value  of  the  weight  vector.  The  mean  weight  vei  *ur 

° - 1 
converges  to  the  iener  Solution  R 1’  when 


0 • g. 
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I 17) 


Where  i I,  2,  ...  N and  X.  (max)  is  the  maximum  eigenvalue  of  the  covari- 

i 

ance  matrix.  Note  the  discrete  time  nature  of  the  problem  leads  <o  the  sta- 
bility criteria  expressed  by  equation  (17). 

The  continuous  time  equation  for  the  weight  vector  may  be  written  for 
comparison  as, 

~ 2pP  - 2pRW  (18) 

dt 

with  solution  for  the  mean  weight  vector  given  by. 


■2p  Rt 


(W  - IIP)  t R_IP 

' r\  ' 


(19) 


Thus,  we  notice  the  total  response  may  be  thought  of  as  a linear  transforma- 
tion of  'he  eigenfunctions  e ^ i for  continuous  time  or  (l-2p  Xi)  for  dis- 
crete time.  The  ’ convergence"  factor  determines  the  rate  of  adaption  or 
response  time  of  the  system  and  because  the  weight  algorithm  is  stochastic, 
the  variance  of  the  weights  will  introduce  a certain  amount  of  degradation  in 

the  mean-square  error.  The  fractional  increase  in  the  latter  or  "misadjust- 

39 

menf  is  given  by  the  expression. 


M p V X.  (20) 

.M  J 

We  should  note  that  small  values  of  p will  minimize  the  misadjustment;  how- 
ever, this  will  result  in  long  response  time  constants  which  may  influence 
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the  convergence  rate  for  nonstationary  type  signals.  In  these  instances,  fhe 
weights  may  not  adapt  rapidly  enough  fo  follow  the  fame- varying  covariance 
matrix. 

The  IMS  algorithm  is  a practical  technique  to  solve  equation  (11)  for  the 
optimal  weights  in  real-time.  The  important  features  of  the  algorithm  are 
i I)  no  explicit  measurements  of  correlation  functions,  (2)  no  large  memory 
storage  or  matrix  inversion,  and  (3)  the  accuracy  is  determined  by  the  sta- 
tistical sample  site.  We  shall  see  these  advantages  permit  us  to  realize  an 
adaptive  signal  processing  system  on  a monolithic  integrated  circuit.  Before 
we  introduce  the  specific  form  of  fhe  L\1S  algorithm,  we  can  combine  equations 
( 2 ) and  (14)  to  write. 


W.  (m+1)  W.(m)  -t  2 p e^m)X  (m-j) 

J J 


(21) 


where  fhe  incremental  weight  update  is  a cross-correlation  between  the  error 
sequence  and  the  data  sequence.  The  process  of  weight  optimization  is  con- 
fided when  the  error  sequence  is  orthogonal  fo  fhe  data  sequence  at  the  par- 

'icular  'ap  location  of  interest.  The  particular  form  of  the  LMS  algorithm 

40 

introduced  by  Widrow  and  Hoff  makes  fhe  approximation, 


2 

e (m ) 


(22) 


e (m ) 

thereby  eliminating  the  need  to  average  over  a large  block  of  data.  The  con- 
sequence of  this  approximation  is  to  alter  equation  (21)  to  the  form, 


W.  (mill  W.(m)  + 2pc(m)X(m-i) 
J J 


(23) 
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with  cross -cor relation  function 


M 

p Z->  e(m)  X (m-il  f Z 4 i 

J m 1 

th 

as  defined  for  the  j <up  over  M data  samples.  Equations  (21)  and  (2  3)  i ay 
he  pictured  as  a correlation  cancellation  loop  which  is  a type  1 servo- 
mechanism that  removes  or  cancels  from  the  output  signal  any  component  of 
the  desired  (main)  input  signal  that  is  correlated  with  the  tapped  data  signal 
(auxiliary).  The  cancellation  (as  shown  in  figure  2)  is  obtained  by  a cont  rolled 
subtraction  of  the  auxiliary  input  from  the  main  input  after  the  former  has 
been  adjusted  in  amplitude  to  maximize  its  correlation  with  the  main  input. 
This  subtraction  process  continues  until  no  correlation  is  defected  between 
the  output  error  (residue)  and  the  auxiliary  input  at  which  time  the  mean  in- 
put to  the  integrator  is  zero.  Thereafter,  the  integrator  output,  which  con- 
trols the  amplitude  adjustment,  remains  constant  unless  the  input  changes. 

The  correlation  cancellation  loop  (COE)  has  two  aspects:  (1)  a correlation 

between  input  signal  samples  from  the  auxiliary  input  of  the  form.  X(m-i) 
X(m-j)  and  (2)  a correlation  between  the  main  input  and  the  auxiliary  input  of 
(lie  form  d(m)X(m-i).  In  order  to  realize  an  adaptive  filter,  X such  (XT 
stages  are  cascaded  as  shown  in  figure  3.  Each  COL,  stage  is  designed  fo 
cancel  a component  of  the  main  input  that  is  correlated  with  the  delayed  ver- 
sion of  the  auxiliary  input  ( i.  e.  , the  tapped  signal  at  'he  OOl.  stage  itself'. 

We  should  note  that  'his  adaptive  filter  is  an  in  plementation  of  <he  or'  ocon- 
alify  principle  in  \ -di  mens  ions  with  a real-time  technique  and  no  inter- 
mediate calculations  are  required.  The  method  shown  in  figure  3 was 
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Figure  2.  Correlation  Cancellation  Loop  (CCL) 
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Figure  3.  Internal  View  of  Adaptive  Filter 
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proposed  by  Lucky  for  adaptive  data  compression  and  later  by  Widrow 
as  an  extension  of  his  original  work.  We  should  notice  the  linear  LMS  al- 
gorithm requires  two  4-quadrant  analog  multipliers  and  an  integrator  or 
storage  element  for  each  CCL  stage.  In  addition,  we  require  an  analog  delay 
line  with  low  loss  and  nondestructive  taps  to  provide  delayed  signals  to  the 
tap  positions  (x  , x , ...  x ). 

1 *—  IN 

3.  1 THE  CLIPPED  DATA  LAIS  ALGORITHM 


The  use  of  conventional  4-quadrant  analog  multipliers  fo  implement  the 
LMS  algorithm  is  not  only  expensive,  but  from  a power  and  size  sta ndpoint, 
quite  impractical,  not  to  mention  the  difficulties  with  accuracy,  speed,  and 
the  eventual  realization  on  an  IG  chip.  Thus,  in  applications  where  a large 

number  of  multipliers  is  anticipated  such  as  adaptive  echo  cancellation  in 

45  46-48 

long  distance  telephone  communication,  analysis  has  been  performed 

to  indicate  the  analog  multipliers  may  be  replaced  by  devices  which  can  be 

implemented  inexpensively  and  with  characteristics  quite  different  from  the 

conventional  multipliers.  The  convergence  of  the  filter  weights  with  nonideal 

multipliers  is  an  important  property  of  the  adaptive  filter  and  makes  such  a 

filter  very  attractive  for  system  identification  as,  for  instance,  in  (he 
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estimation  of  speech  parameter.  The  nonideal  multiplier  may  be  of  the  gen- 
e ral  fo  rm, 

(a  • b)  (t)  a(f)  f [b(t)]  (25) 

where  (a  • b)  (t)  denotes  the  output  of  the  nonideal  multiplier  at  time  t with 
inputs  a(t ) and  b(t).  f[b(t)]  is  a monotonic  function  of  b(t)  and  the  multiplier 

output  need  only  to  be  linear  in  one  of  the  inputs.  For  example,  the  multi- 
plier which  gene  rates  the  product  2p«  (t)  X(t)  might  be  written  as, 

(€•  X)(t)  eft)  f [ X ( t )]  (2f.) 

€ (t)  sgn  X(t) 

where  the  auxiliary  or  delay  input  data  is  ’ clipped"  to  retain  information  about 

the  polarity  of  the  received  data.  Notice  the  error  t (t)  is  still  computed  with 

f he  amplitude  and  sign  information  of  X(t)  (i.  e.  , in  a linear  manner),  whereas 

die  polarity  is  used  fo  determine  the  direction  of  weight  adjustment.  Mosch- 
48  , 

ner  was  the  first  author  to  treat  this  particular  modification  of  the  LMS 
algorithm  and  he  referred  fo  the  algorithm 


W (m+1)  W.(m)  + 2pe(m)sgn  [X(m-j)] 

as  the  "clipped  data"  LMS  algorithm,  where 


(27) 


sgn  [X(m-j)]  1 X(m-j)  ■ 0 

-1  X(m-j)-  0 


(28) 


T 

As  Moschner  noted,  ' Once  W X has  been  computed,  the  LMS  algorithm 
requires  an  additional  N-tl  additions  or  subtractions  and  Nt  1 multiplications. 


D.  Mitra  and  M.  M.  Sondhi,  "Adaptive  Filte  ring  with  Non-Ideal  Multipliers, 
Applications  to  Echo  Cancellation,"  Inf ’ 1 Conf.  on  Communications  Vol.  II 
(1975),  pg.  30,  June  1975,  San  Fancisco,  Calif. 

J.  1..  Moschner,  "Adaptive  Filter  with  Clipped  Input  Data,"  Stanford  Lab. 
Kept.  No.  6796-1,  June  1970. 
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For  die  clipped  LMS  algorithm,  however,  the  components  of  X must  be  either 
• 1 or  -1,  so  multiplication  by  X is  not  required.  The  N multiplications  can 
be  replaced  by  N conditional -b ranch  operations,  which  check  the  sign  of 
X(m-j)and  on  this  basis  add  or  subtract  the  quantity  2pt(m).  By  eliminating 
X multiplications,  the  clipped  algorithm  offers  a distinct  advantage  in  speed 
of  operation.'  Moschner  went  on  to  show  this  simplification  slowed  the  speed 
of  adapfion  by  a factor  of  tt/2  (when  compared  with  the  LMS  algorithm)  with 
no  change  in  the  converged  level  of  performance  since  the  estimation  is  still 
performed  with  the  complete  data  signals.  The  simplicity  of  this  algorithm, 
from  the  standpoint  of  IC  implernentat ior.,  is  immediately  apparent  since  X 
4-quadrant  analog  multiplications  are  replaced  by  X simple  polarity  switches 
to  steer  ±2pe(m)  to  the  appropriate  weight.  Furthermore,  the  polarity  of  the 
data  may  be  determined  in  a sequential  operation  with  the  analog  data  X(m-j) 
in  an  analog  delay  line  ( i.  e.  , tapped  CCD  delay  line)  and  its  polarity  sgn 
[X(  m-i]  in  a parallel  digital  delay  line  (i.e.  , tapped  PMOS  shift  register), 
both  delay  lines  synchronously  clocked.  Thus,  because  of  the  sequential 
nature  of  the  data  flow  in  the  adaptive  transversal  filter,  the  X conditional- 
branch  operations  require  only  a single  input  comparator  instead  of  a com- 
parator for  each  CCL  stage  in  the  filter. 

The  adaptive  filter  of  figure  3 may  be  modified  as  shown  in  figure  4.  The 
exclusive  OR  gates  perform  a binary  multiplication  of  the  quantities  sgn 
[ r (in)]  and  sgn  [ X(m-j )]  {i.e.,  sgn  [c(m)]  (x  sgn  [X(m-j5]{  to  generate  an 
output  signal  to  control  the  polarity  switches.  The  polarity  switches  serve  as 
single  pole -double -th row  type  to  direct  the  scaled  error  ±2*iC(m)  to  the  ap- 
propriate weight.  As  wfe  will  see  later,  the  functions  of  integration  (storage) 
and  multiplication  (weighting)  can  be  performed  by  a single  VINOS  nonvola- 
tile memory  transistor  operating  in  its  triode  region  as  a linear  conductance 
multiplier  to  convert  a tapped  analog  voltage  to  current.  An  alternative 
method  is  to  use  bidirectional  charge-control  to  set  the  analog  conductance 
of  ,t  MOS  multiplier.  These  techniques  are  discussed  in  Section  5. 
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Figure  4.  Adaptive  Filter  with  Cascaded  CCL's  to  Implement 
' Clipped  Data"  LMS  Algorithm 

3.2  OTHER  FORMS  OF  THE  LMS  ALGORITHM 

We  have  discussed  two  forms  of  the  LMS  algorithm  which  lead  to  cross- 
correlation functions: 

° i ( 1 LMS r ) L c(m)X(m-jl  (291 

J m=  1 

(Clipped  v M 

Data  | Y e(™)  sgn  [X(n>j)] 

LMS  ' m=  1 

The  LMS  algorithm,  as  we  have  discussed,  cross-correlates  the  output  error 
with  the  tapped  data  ( i.  e.  , delayed  data  signal)  at  each  tap  to  generate  the 
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update  or  incremental  adjustment  for  die  tap  weight.  There  are  two  other 

49 

forms  of  the  LMS  algorithm  which  have  been  treated  in  the  literature: 


P (Hybrid) 
1 


M 

Y X(m-i)  spn  (cfni)] 

m 1 


, Modified 
Zero 

' Forcing 


M 

Y sgn  [c (m )]  sgn  [X(m-j)j 

m 1 


(30) 


The  work  of  Hirsch  and  Wolf  is  interesting  since  they  compared  various  'ypes 

of  algorithms  for  the  application  of  adaptive  equalization  as  well  as  introduce 

49 

the  field-effect  transistor  for  voltage-controlled  conductance  tap  //eights. 

In  the  1960's,  the  use  of  adaptive  filters  was  an  important  commercial  out- 
growth of  research  and  development  of  algorithms  by  the  Bell  Telephone 
Laboratories.  ’ The  adaptive  equalizer  is  used  in  high-speed  MODEM'S 
for  dieital  communication  and  connecting  remote  terminals  to  computers  as 
well  as  computer  to  computer.  The  rate  and  accuracy  of  the  data  transmis- 
sion is  increased  by  equalizing  the  baseband  distortion  and  reducing  the  inter- 

52 

symbol  interference.  The  early  adaptive  equalizer  development  used  the 
so-called  zero-forcing  (ZF)  algo rithm  which  minimized  the  expression 


M 

p.  (ZF)  Y sgn  [c(m)j  sgn  ^Y(m-j)]  (31) 

m 1 


49 

D.  Hirsch  and  W.  Wolf,  ' A Simple  Adaptive  Equalizer  for  Efficient  Data 
Transmission,"  IEEE  Trans.  Comm.  Tech.  , Com  - 1 8,  5 (1970). 

R.  Lucky,  "Automatic  Equalization  for  Digital  Communications," 

B.  S.  T.  J.  , 44j  547  (1965). 

51 

R.  Lucky,  et.  al.  , Principles  of  Data  Communications,  New  York: 
McGraw-Hill  (1968). 

52 

R.  W.  Lucky,  "Techniques  for  Adaptive  Equalization  of  Digital  Communica- 
tion Systems,"  B.  S.  T.  .1.  , 44,  547  (196  5). 
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where  the  output  error  is  cross-correlated  with  delayed  versions  of  the 

equalized  output.  For  random  data  and  unequalized  inputs  with  so-called 

open'  binary-eye  patterns,  the  p.'s  are  estimates  of  the  equalized  pulse 

J th 

response  and  the  ZF  algorithm  adiusts  the  j tap  weight  to  force  P to  zero 

j 

(except  the  center  tap  of  the  equalizer  which  corresponds  to  the  peak  of  the 
pulse).  The  convergence  properties  of  the  ZF  algo  rithm  we  re  inferior  to  the 
mean  square  error  (MS)  algorithm  because  for  "closed"  binary-eye  patterns 
the  covergence  was  not  guaranteed  since  the  slicing  operations  (with  com- 
parators) yielded  an  unreliable  estimated  reference  (main  or  desired 
input).  Subsequently,  the  adaptive  equalizer  development  emphasized  the  use 

of  the  MS  algorithm.  An  interesting  comparison  of  the  ZF,  MS,  Hyb.  , and 

49 

MSF  algorithms  was  presented  by  Hirsch  and  Wolf  as  illustrated  in  figure 
5 for  the  equalized  peak  distortion  defined  by  the  expression 

_ | | summed  over  all  taps 

D , t ) p . (32) 

peax  - | j | except  center  tap 

3.  3 A 2-TAP  WEIGHT  ADAPTIVE  FILTER  UNDER  THE  CONTROL  OF  THE 
"CLIPPED  DATA"  LMS  ALGORITHM 

In  this  section,  we  will  present  a simple  analysis  of  a 2-tap  weight  adap- 
tive filter  under  the  control  of  the  "clipped  data1'  LMS  algorithm.  Figure  6 
illustrates  a block  diagram  of  the  adaptive  filter.  We  will  analyze  this  adap- 
tive filter  for  a sinusoidal  signal  in  the  presence  of  white  noise.  The  desired 
signal  may  be  written  as, 


d(t)  = d cos  (ut  + <$) 


o 

where  6 is  a relative  phase-shift  with  respect  to  the  signal  at  tap  1. 
tapped  signals  are, 

X,(t)  = X cos  «t  + n,(t) 

1 o 1 

X,(t)  = X cos  u(t-T)  + n (t) 


(33) 

The 


(34) 
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whe  re  T is  the  time  delay  between  tap  positions  and  rij(t),  n^(t)  are  uncore- 
lated  noises  at  the  tap  positions.  The  matrix  elements  of  the  covariance 
matrix  (see  equation  9)  become, 


X ^(t)  sgn  [X  j (t)]  (s+iij)  sgn  (stn^)  s sgn  s + n^  sgn  n^ 

2X 


2 


(35) 


whe  re 


nj  (t)  n.}  (t) 


n j(t)n.j(t)  stij 


sn2  0 


Calculation  of  the  remaining  matrix  elements  yields 

2X 


X ^(t)  sgn  [X^(t)J  X.?(t)  sgn  [X^(t)J 

2d 

d(  t ) sgn  £ X ( t )] 


cos  w T 


d(t)  sgn  X (t)] 


7T 

Id 


COS  <J> 


cos  (uT  + <t>) 


which  yields  the  weight  equation  (see  equation  18): 


d_ 

dt 


W 


W„ 


(36) 


(37) 


(38) 


The  above  equation  for  the  weights  illustrates  the  c ross  - coupling  between  the 
taps  caused  by  the  delay  T and  when  uT  (2ktl)tr/2,  k 0,  1,  2.  . . the  system 
is  decoupled  and  in  so-called  normal  form.  We  can  transform  the  weights 
into  a normal  coordinate  system  with 


W fj)  T) 


(39) 
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whe  re 


is  the  transformation  matrix.  Application  of  this  transformation  to  equation 
(18)  yields 


d_ 

r i\ 

4g  d 

o 

/ cos  $ 

- cos  (w  T 

_f  j>]_\ 

dt 

\n  2 / 

\2  7t 

\ cos  d 

+ cos  (gj  T 

+ <?)  / 

2u  I 


- (1  - cos  u T) 

[ » ! 

0 

0 

i 

2X 

[z 

i 

i 

o 

7 T 

(1  t cos  u T)  + 

with  equations  (39)  and  (41)  we  can  write  the  transient  weight  response  of  the 
normal  weights  in  terms  of  time  constants. 


1 

'2.X  fz 

( 1 - costoT)  + a 

L 7T  ’ n n -I 


2X  J2 

2u  (1  -t  cosuT)  +%  — 0 

r L tr  " tr  n 


and  a steady  state  solution  for  fhe  weights  becomes 

d \(  X + ” \cos  <t>  - X cosuT  cos  (toT‘  <f>) 

oi  \ o 1 2 n / o _ 


\V  - p , 2 

(x„  * Vz  ' J * tos  “r 


W^fs.s.)  = 


dlYx  + J—  * ) cos  (uT  + <£  ) - X cos  <f>  cos  wT 
oL'  o T 2 n/ o 

(x  t %[—  a )^  + cos  wT 
\ o T 2 n ' 
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which  we  observe  is  a function  of  frequency  providing  ojT  / (2k  + l)7r/2,  k 0, 
1.  2,  ....  When  this  condition  is  approached,  the  optimal  weights  approach 
the  values, 


(opt.  ) 

->  d cos  <b 
o 

x + V? a 

o f 2 n 

(opt.  ) 

-»  -d  sin  <4 

o 

x + a 

o f 2 n 

uT  = (2k  + 1 ) tt/2 


(44) 


and  the  weights  are  decoupled  from  one  another  as  the  coordinate  system  ap- 
proaches normal  form. 

53 

(.lover  has  analyzed  the  particular  case  when  there  is  a 90  degree  phase 
shift  between  the  weights  for  adaptive  noise  cancelling  in  the  form  of  a notch 
filter.  He  showed  when  a sum  of  sinusoids  is  applied  to  an  adaptive  filter, 
the  filter  converges  to  a dynamic  solution  in  which  the  weights  are  time  vary- 
ing. This  time-varying  solution  gives  rise  to  a tunable  notch  filter  with  a 
notch  located  at  each  of  the  reference  frequencies.  In  the  example  considered, 

*he  desired  and  reference  inputs  were  operating  at  the  same  frequency  (i.  e.  , 

5 3 

ffj  f ^ ) . Clover  showed  for  f p f the  weights  have  a dynamic  stealy- 

state  response  with  an  oscillation  at  the  difference  frequency  f - f and  the 

d r 

instantaneous  response  at  f . This  time-varying  solution  should  not  be  con- 

r 

sidered  as  noise  in  the  adaptation  process.  In  essence,  the  time-varying 
weights  modulate  the  reference  frequency  f and  hetrodyne  it  into  the  desired 
frequency  f , thus,  creating  a notch  effect. 


J.  R.  Glover,  "Adaptive  Noise  Cancelling  of  Sinusoidal  Interference," 
Naval  Underseas  Center,  San  Diego,  Calif.  Rep't  # TN  If.  17,  Dec.  1975. 
(Stanford  University  Ph.  D.  Thesis). 
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3.  3.  1 A 2-TAP  ADAPTIVE  NOTCH  FILTER 


In  this  section  we  will  examine  a simple  single-frequency  noise  canceller 
with  2-adaptive  weights  under  the  operation  of  the  ' clipped  data’  LMS  al- 
gorithm. Figure  7 illustrates  the  single  frequency  noise  canceller  in  which 
the  desired  input  may  be  any  type  of  signal  (i.e.  , stochastic,  deterministic, 
periodic,  transient,  or  combination  thereof)  while  the  input  signal  is  a pure 
cosine  wave  X cos  (w^t  - $)•  The  desired  and  input  signals  are  sampled 
synchronously  at  f ^ 1 / T with  a 90  degree  phase  between  Xj  and  X^  faps. 

The  algorithm  for  updating  the  weights  is, 


W j (m  + 1)  W j (m)  + 2p  e (m)sgn  [X  (m)J 

W, (m)+  1)  W^(m)  + 2p  e (m)  sgn  [ X ^ (m)] 

where, 

X,  (m)  = X cos  (to  mT  - <j>) 

1 o o 

X_  (m)  = X sin  (u  mT  - <j>) 

2 o o 


(45) 


(40) 


The  first  step  in  the  analysis  is  to  consider  the  adaptive  noise  canceller 
as  a feedback  network  with  the  filter  output  Y(m)  disconnected.  Under  these 
conditions,  a unit  impulse  at  m k is  applied  at  the  desired  input  to  create 
an  error, 


1 m-k 
0 m/k 

The  transfer  function  of  the  incremental  weight 


(47) 

change  may  be  written  as. 


z { W j ( m + I)  - VV}  (m)  j (7.-1)  W]  (7) 


(48) 


o r 


Wj(Z)  U(7)  z { 2p€  (m)  sgn  [X}  (m)]} 


(49) 
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Figure  7.  Single  Frequency  Adaptive  Noise  Canceller 

Where  U(Z)  (Z-l)  \ The  impulse  response  of  U(Z)  is  the  step  response, 

1 m ^ 1 

u(m-l)  (50) 

0  rn  < 1 

Convolution  of  u(m-l)with  2pe(m)sgn  [Xj(m)]  yields  the  weight, 

W,(m)  2psgnfcos(w  kT  - <£)]  m k + 1 (51) 

1 L o J 

and  the  corresponding  filter  output  is, 


Y,(m)  2p  X cos  (w  mT  - <f>)  sgn  f cos  (w  kT  - $ ) ] m k+1  (52) 

1 o o L o 

.Similarly, 

Y_(m)  2p  X sin  (w  mT-i)  sgn  f sin  (<*>  kT-^)l  m^ktl  (52) 

2 o o L o J 
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with  the  total  output, 


Y(m)  = Y (m)  + Y (m)  = 2uX  cos  (u  mT  - ® ) sgn  [cos  (cj  kT  - <f>  )"| 
1 2 0L0  Lo  J 

t sin  (u  mT  - <j>)  sgn  [sinCco  kT  - <j>  )]J  m k + 1 (53) 


Equations  47  and  53  may  be  /.-transformed  to  yield  the  pulse  transfer  function. 

|z  cos  [(k  + l)uj  T - 0 - 7r / 4j  - cos  [kto  T - 6 - z 4]  i 


G(Z,  k)  = 2p  V 2 X 


Z - 2Z  cos  w T + 1 

o 


where  0°  v ku>  T - •»  ir/2,  since  the  above  transfer  function  repeats  every 

o 

90  degrees.  In  the  above  form,  G(Z,  k)  is  nontime-invariant, and  in  order  to 
remove  the  k-dependence,we  will  average  over  the  period  indicated  to  obtain 


G'(  Z ) = 


8pX  (Z  cos  o T-l) 
o o 

Z2  - 2Z  cos  w T + l 


Since  the  closed-loop  transfer  function  is 


111 


1 + G(Z) 


nth  closed-loop  zeroes  given  as 


± j u)  T 
e " o 


and  poles  from  the  solution  of  1 + G(Z)  0.  If  we  make  the  narrowband 
approximation  with  p X • 1,  then  the  poles  are  inside  the  unit  circle  with 

a radial  distance. 


1 - 8p 


1 - 4p 


from  the  origin  as  shown  in  figure  38.  The  angles  of  the  poles  are  almost 
identical  to  those  of  the  zeroes  with  a notch  filter  bandwidth 


8p  X 


B.  W. 


with  <i  Q, 


U 


B.  W. 


-)  T 
o 

8 n X 

o 


(6  0) 


A special  case  of  the  notch  filter  is  to  uj  0 in  equations  55  and  56  to 
yield 


H(Z,  w 0) 
o 


Z - 1 


z - (1 


8 


M-X 

o 


) 


(6  1 ) 


which  places  the  notch  at  zero  frequency  to  cancel  low  frequency  drift.  Since 
there  is  no  need  to  match  the  phase  of  the  signal,  only  one  weight  is  needed. 
The  bandwidth  is  given  by  equation  59  and  the  transfer  function,  expressed 
b\  equatioti  61,  indicates  a pole-zero  separation  of, 

8 p X 
o_ 

TT 

on  the  real  axis.  The  use  of  a bias  weight  can  remove  slowh  varying  drift 
components  in  the  input  signal  and  may  be  used  simultaneously  with  opera- 
tion to  cancel  periodic  or  stochastic  interference. 


WO 


I 


4.  CHARGE- COT  PLED  DEVICES  (CCD'S)  WJTFI  ANALOG 
CONDUC  I'ANCE  WEIGHTS 


I 

t 


In  figure  1 we  observed  that  a basic  requirement  of  the  linear  combiner  is 

54 

the  analog  delay  line.  The  cha  rge  - coupled  device  (CCD)  analog  shift  reg- 
ister processes  discrete  analog  samples  of  input  data  through  the  translation 
of  charge  p fleets  in  synchronization  with  an  external  clock.  CCD  basic  build- 
ing blocks  provide  a flexible  approach  to  discrete  analog  signal  processing 

55  56 

in  systems.  One-dimensional  basic  building  blocks  (linear  arrays)  may 

be  classified  according  to  the  characteristic  information  flow  patterns: 

a.  Serial  in /serial  out  (SI /SO) 

b.  Parallel  in/serial  out  (PI /SO) 

c.  Serial  in/parallel  out  (SI/PO) 

A simplification  of  the  CCD  analog  shift  register  (SI /SO)  is  shown  in  figure 
9 and  the  clock  timing  in  figure  10.  The  timing  is  arranged  so  the  switch 
toggling  frequency  is  one-half  of  the  4-phase  clock  frequency.  Thus,  the 

5 7 

input  sampling  switch,  S^,  alternately  samples  data  and  zero  reference. 


W.  S.  Boyle  and  C.  E.  Smith,  1 Charge-Coupled  Semiconductor  Devices,' 

D.S.  T.  J.  , 49,  687  (1970). 

65  - 

M.  H.  White  and  D.  R.  Lampe,  "Cha rge -Coupled  Device  (CCD)  Analog  Signal 
Processing,  1 IEEE  Press  Selected  Reprint  Series,  Charge-Coupled 
Devices;  Technology  and  Applications,  R.  Melen  and  D.  Buss,  eds.  , 

IEEE,  N.  Y.  - (1977). 
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D.  R.  Lampe,  M.  II.  White,  W.  R.  Webb,  J.  II.  Mims  and  G.  A.  Gilmour, 
"CCD’s  for  Discrete  Analog  Signal  Processing  (HASP),"  IiYTERCON  74, 
March  1974,  New  York. 
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J.  Matte rn  and  D.  R.  Lampe,  "A  Reprogrammable  Filter  Tank  Using  CCD 
Discrete  Analog  Signal  Processing,'  1975  ISSCC,  pg.  148,  Technical 
Digest,  Feb.  12-14,  1925,  Phil.  Pa. 
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At  the  output,  switch  S clamps  during  zero  reference,  samples  during  data, 
and  holds  when  if  is  not  actually  sampling.  The  output  capacitor,  therefore, 
contains  only  the  ''time-stretched"  data  samples.  In  a shift  register  with  N 
pairs  of  stages,  there  will  be  N signal  samples  and  X zero  reference  samples, 
each  of  duration  T/2.  There  are  several  advantages  associated  with  this 
technique  of  data  flow: 

• Increased  isolation  between  data  samples  (i.  e.  , reduction  in  cross- 
talk  between  samples)  with  minimal  signal  loss 

• The  reference  sample  and  signal  sample  pass  through  fhe  same  path 
and  first-order  offsets  can  be  corrected  in  Pl/SO  and  SI  PO  struc- 
tures 

• Increased  spatial  extension  between  taps  on  a SI/PO  structure  to  aid 
in  layout  of  peripheral  processing  circuitry. 

Figure  10  illustrates  a complementary  4-phase  clock  sequence  for  operat- 
ing a SI/SO  CCD.  The  waveforms  through  4>  ^ are  the  4-phase  clocks  whose 
function  is  to  propagate  charge  dow'n  the  line  without  dispersion.  V.  aveform 
Sj  demonstrates  the  input  switch  functions:  data  is  sampled  in  the  up  position, 

and  zero  reference  is  sampled  in  the  down  position.  \ demonstrates  the 

o 

appearance  of  the  delay  line  output  voltage  with  the  alternate  data  and  zero 
reference  outputs  confined  to  3/8T.  S.,  demonstrates  the  output  processing 

functions:  the  data  is  sampled  in  the  up  position,  the  zero  is  damped  in  the 
down  position,  and  the  data  is  held  when  if  is  not  sampled  (center).  The 
interval  from  data  sample  to  data  sample  is  T and  the  total  transport  time  is 
XT  where  X is  the  number  of  CCD  analog  delay  line  data  stages.  Thus,  the 
signal  delay  for  a SI/SO  CCD  analog  shift  register  is, 

r NT  N/f 

c 

which  illustrates  'he  electrically  alterable  delay  feature  of  the  (,CD  delay 
line.  Since  the  sampling  therein  requires  the  analog  signal  to  be  sampled  at 
leas'  twice  during  the  pe  riod  of  the  highest  component  of  interest,  wc  may 
write 
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si  toggling  frequency^  1/T 


_ 74  1 147  VA  3-1 

4 i^ClOCk  FREQUENCY:  2/1 


Figure  9.  CCD  Analog  Shift  (SI  /SO) 


f - “ T f (max)  (63) 

s 2 s 

and  the  time-delay  bandwidth  product  becomes, 

f - N/2  (64) 

s 

The  low  frequency  limit  is  set  by  the  thermal  leakage  current  which  accumu- 
lates m each  stage,  and  the  upper  frequency  limit  is  determined  by  input 
charge  injection,  transfer  efficiency,  and  output  charge  detection  and  recon- 
struction circuitry.  Figure  11  illustrates  a cross-section  of  a 4-phase  elec- 
trode CCD  with  transfer  and  storage  electrode  dimensions.  The  CCD  is 
fabricated  with  PMOS  silicon-gate  technology  and  the  insulator  is  a dual- 
dielectric comprised  of  silicon  nitride  (Si  ,N^)  over  thermal  silicon  dioxide 
(SiO^l.  The  electrodes  are  fabricated  with  poly c ry stalline  silicon  and  alumi- 
num, to  give  coplanar  but  overlapping  electrodes.  The  overlapping  elec- 
trode feature  provides  a sealed'1  CCD  surface  and  stable  operation  under 
lemperature-bias  excursions.  Structures  may  be  fabricated  with  both  elec- 
trodes made  of  polycrystalline  silicon.  Although,  the  dimensions  used  in 
the  CCD's  discussed  in  this  report  are  8pm  A1  and  12pmPolySi.,  we  have  fab- 
ricated CCD’s  with  4|i  m length  Poly  Si  electrodes. 

58 

The  CCD  delay  line  provides  a unidirectional  transfer  of  charge  q^  (x,  t) 
from  one  storage  cell  to  another  adjacent  cell.  The  signal  charge  is  designated 
in  cell  X at  time  t,  where  X and  t assume  integer  values;  i.  e.  , the  unit  of 
distance  is  the  cell-to-cell  separation  X^,  and  the  unit  of  time  is  the  clock 
period  T.  1'he  frequency  response  of  the  CCD  delay  line  due  to  transfer  in- 
efficiency e per  stage  delay  may  be  calculated  from  a discrete  formulation: 

q(x,t)  f q (x,  t-1)  + (1-f  ) q (x-l,t-l)  (t>5) 

s s s 


Sh\V.B.  Joyce  and  W.J.  Bertram,  "Linearized  Dispersion  Related  and 
Green’s  Function  for  Discrete  Charge  Transfer  Devices  with  Incomplete 
Transfer,'  B.  S.  1 . J.  , 80,  1741  (1071). 
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where  C /(  is  the  ratio  of  input  to  output  capacitances  and  j is  the 

in  OUT 

transconductance  oi  the  on-chip  amplifier  while  R , , is  the  off-chip  feedback 
resistor  in  an  operational  summing  amplifier.  In  order  to  minimize  >■  upli- 
t ind  freq  lency  dispersion  in  a CCD  analog  delay  line,  w e shi  ild  res tri<  t 
'.t  < .1  and  prefer  ruble  considerably  less.  1 or  example,  if  . 1, 

tiiei.  the  insertion  loss  is  -1.8  di  > at  two  Nyquist  limit  (f  - 0,  5 f^)  and  ■ 
maximum  phase  deviation  from  linearity  is  ±3°  at  1 = 0.  ^ • 

The  SI/SO  block  is  a simple  CCD  analog  siiift  register  to  provide  the 
basic  function  of  delav  for  the  linear  combiner  of  the  LMS  adaptive  filler  . 

Typical  dynamic  ranee  has  been  measured  on  SI/  SO  structures  us, 


I Pk.  to  Pk.  Signal  \ 

D.  R.  [ . ) 

' r.  m.  s.  noise  / 

S/N 


100  dl’i  narrowband  f 1?  kHz 

s 

with  ±0.  5Y  input  signal 


D.  R. 


fundamental  of  output 
at  f 

s 

2nd  harmonic  of  output 
at  2 f 


55  dB  f - 1 kHz  1 = 200  kHz 

s c 

with  ±0.  5V  input  signal 


in  which  the  linear  dynamic  range  illustrates  the  accuracy  ol  the  naloc 

delay  line  (i.  e.  equivalent  to  9 digital  bits),  rhis  accuracy  impr  .*• 

the  inp  it  signal  is  reduced  since  the  distortion  associated  with  the  input 

ection  tnd  itp  t detection  circuitry  is  reduced,  rhe  cl  < ■ luire  ents 

ry  from  rTL  level  on  juried  channel  CCD’s  to  CMOS/M  levels 

on  surface  channel  CCD's.  In  general,  CMOS  levels  (i.  e.  10  'o  18\  ' a re 

needed  to  obtain  the  dynamic  range  and  frequency  response.  Since  the  U D 

pled  data  system  pre- and  post-filtering  of  the  t.  • lit  req  ired 

ut) 

(ideally  a filter  with  a sharp  cutoff  ,t  0.  5 f ) to  limit  aliasing  effects. 


I.  Sequin  and  M.  F.  rompseff,  Charge  Transfer  Devices  (Supplei  e 

\d\  inces  in  Electronic nd  Electron  Physics),  New  York:  \c  idemi< 

Prrss  ( 1/7  S). 


4.  1 SERIAL  IN'  /PARALLEL  OUT  (SI/PO)  TRANSVERSAL  FILTERING 
WITH  CHARGE-COUPLED  DEVICES  (CCD's) 

CCD  transversal  filters  with  fixed  analog  tap  weights  have  been  implement- 
ed with  the  split-electrode  weighting  technique.  In  this  method,  a CCD 
delay  line  becomes  a transversal  filter  by  splitting  one  of  the  electrodes  in 
each  delay  line  and  placing  a differential  current  integrator  in  the  clock  line 
instead  of  the  conventional  output  amplifier.  In  the  adaptive  filter  approach, 
we  require  adaptive  or  electronically  reprogrammable  filters.  In  this 
section,  a SI/PO  CCD  is  discussed  which  features  independent,  nondestruc- 
tive, low-impedance  voltage  readouts  of  delayed  analog  signals  at  specified 
locations  or  taps  along  the  CCD  delay  line.  In  general,  the  signal  voltage  at 
each  tap  may  be  multipl icatively  weighted  by  a conductance  to  give  a current 
proportional  to  the  product  of  the  signal  voltage  and  the  weighting  conductance. 
Figure  12  illustrates  a photomicrograph  of  a SI/PO  block  (N  20  outputs) 

which  uses  a floating  clock  electrode  sensor  at  alternate  stage  delays  along 

62 

the  CCD  delay  line.  This  permits  the  use  of  a " refe rence -only'  and 
signal  and  reference’’  to  compensate  for  nonuniformities  in  the  SI/PO 
structure.  Numerous  taps  with  multiplicative  analog  weighting  can  be  ac- 
commodated without  signal  amplitude  degradation  due  to  stray  parasitic 
capacitance,  by  paralleling  SI/PO  blocks  of  feasible  size  due  to  the  summa- 
tion of  product  currents.  Furthermore,  the  independent  nondestructive 
voltage  taps  of  the  SI/PO  block  can  provide  the  analog  voltage  signals  needed 
by  multipliers  to  give  CCD  real-time  analog  correlation.  Use  of  program- 
mable conductances  such  as  the  nonvolatile  MNOS  type  or  conventional  MOS 
type  permit  such  device  applications  as  adaptive  transversal  line  equalizer 
or  programmable  matched  filter  (or  correlation  detector)  for  secure  voice/ 
data  communications  systems. 

6 1 D.  D.  Buss,  D.  R.  Collins,  W.  H.  Bailey,  and  C.  R.  Reeves,  "Transversal 
Filtering  Using  Charge  Transfer  Devices,"  IEEE  J.  Solid-State  Circuits, 
SC-8, 134  (1973) 

62  M .11.  White,  I.  A.  Mack,  F.  J.  Kub,  D.  R.  Lampe,  andJ.  L.  Fagan,  "An 
Analog  CCD  T rans ve  rsal  Filte  r with  FT oa ting  Clock  Electrode  Sensor  and 

VariableTap Cain,  " ISSCC  76,  Iechnical  Digest  pg.  194,  Phildelphia,  Pa. 
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Fiirure  12.  Photomic roiiraph  of  SI/I’O  CCD  Basic  Building’  ! lock  lor 
Tapped  Analou  Delay  l.ine  of  1. inear  Combiner 


Hie  ability  to  easily  change  or  modify  the  transfer  function  of  a system  or 
subsystem  requires  central  components  whose  characteristics  are  determined 
by  a few  variable  parameters.  In  applications  involving  filtering  of  sampled 
data,  the  transversal  filter  is  the  primary  component.  Figure  13  illustrates 

a transversal  filter  which  consists  of  an  N-stage  tapped  delay  line  and  asso- 

63 

mated  weights  at  each  tap  point. 

th 

The  output  of  the  transversal  filter  at  the  m clock  time  can  be  represent- 
ed as 


N 

E 


e (mT)  V W e.  (ml  - kT) 
° k 1 k 1 


(68) 


where  I'  is  the  time  delay  between  successive  tap  locations  in  the  delay  line. 
If  the  input  to  the  filter  is  written  in  the  form 


e.  ( mT  - kT)  e 

l 


jZ t.{  (mT  - kT) 
s 


(69) 


where  f is  the  frequency  of  the  input  signal,  the  magnitude  of  the  output 
s 

becomes 


2n  Uk 


e (U) 

N N 

y W,  e 

o 

k 1 

(70) 


where  1 Nf  T is  the  normalized  frequency,  e (O  is  the  discrete  Fourier 
s o 

transform  of  the  weights  W.^.  The  type  of  filter,  bandpass,  low-pass,  high- 
pass,  etc,  is  determined  by  the  weighting  coefficients  W,  while  the  charac- 
teristics of  the  filter  are  determined  by  the  number  of  taps,  N,  and  the 
interstage  delay  time,  T. 
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Figure  13.  Transversal  Filter 


The  analog  delay  line  nature  of  the  CCD  provides  a means  for  implementin 

, , 64-66 

an  analog  transversal  filter  providing: 


1)  'he  signal  in  the  delay  line  can  be  sensed  nondesf  ruc'i vely 

2)  the  signal  at  each  lap  location  is  appropriately  weighted,  and 

3)  flie  outputs  are  simultaneously  summed. 


»'  4 


D.  D.  Buss,  D.  R.  Collins,  W.  H.  Bailey,  and  C.  R,  Reeves,  Transversal 
Filtering  Using  Charge  Coupled  Devices,"  IEEE  Journal  of  Solid-State 
Ci  remit  s,  SC  -8.  pp.  138  - 14b. 


A.  Ibrahim  and  I..  Sellars,  "CCD's  for  Transversal  Filter  Applications," 
IEEE  International  Electron  Devices  Meeting,  Technical  Digest,  December 
1974,  pp.  240-243. 
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J.  J.  Tiemann,  Vi.  E.  Engler,  R.  D.  Baertsch,  and  D.  M.  Brown,  "Intracell 
Charge  - Transfer  Structures  for  Signal  Processing,  IEEE  Transversal 
on  Electron  Devices,  ED-21,  \1ay  ll)74,  pp.  300. 


One  technique  for  implementing  a GOD  transversal  filter  is  *o  sense  dis- 
placement current  with  a floating  gate  electrode  sensor  and  weight  the  charge 
at  each  tap  with  split  electrodes.  1 The  filter(s)  ' , implemented  on  a par- 
ticular chip,  is  formed  during  chip  fabrication  via  the  configuration  of  the 
split  electrodes.  A second  technique  employs  a floating  clock  electrode 

sensor  with  tap  weights  which  are  independent  of  the  intrinsic  CCD  struc- 

68 

fure. 

4.  2 FLOATING  CLOCK  ELECTRODE  SENSOR 

Figure  14  illustrates  the  ' floating  clock  electrode  sensor1  (FCES)  mono- 
lithic bipolar/MOS  circuit  which  is  employed  at  each  tap  location  of  the  CCD. 
Operation  of  the  FCES  circuit  may  be  explained  with  the  use  of  figure  14  and 
fhe  timing  diagram  shown  in  figure  IS, 

As  <j> 2R  goes  negative  and  <£2  goes  positive,  charge  under  the  $ 2 electrode, 

‘he  ' sensing'  electrode  for  the  FCES  circuit,  is  transferred  under  the  03 
electrode  which  is  low  and  hence  ' accepting"  charge.  (Negative  clock  levels 
are  repulsive  fo  charge  packets.  ) After  6 2 goes  low,  the  6 2 electrode  is 
made  aft  ractive  and  hence  ready  to  receive  charge  when  <t> l goes  attractive. 

The  turnoff  of  <i  disconnects  the  d»->  clock  line  from  the  <£•,  electrode, 

L*  1\ 

which  now  floats  . Next,  the  bj  barrier  is  lowered  and  charge  is  trans- 
ferred in  a progressive  push-clock  manner  under  the  6>  electrode,  and  the 
displacement  current  is  sensed  by  Q . The  voltage  change  on  the  gate  of 
Q.,  is  transferred  to  the  bipolar  emitter-follower  via  the  inverter  or  source- 

follower  operation  of  the  Q /Q  pair.  The  purpose  of  the  bipolar  device 

2 3 

67 

A.  A.  Ibrahim,  G.  J.  Hupe,  L.  P.  Sellars,  'Multiple  Filte  r Cha  racte  ristics 
sing  a Single  C CD  Structure,’  in  1975  Proceedings  of  CCD  Applications 
( onfe  rencc,  October,  1975,  pp.  245-249. 
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M.  H.  White,  1.  A.  Mack,  F.J.  Kub,  D.  R.  Lampe,  and  J.  F.  Fagan,  "An 
Analog  GOD  Transversal  Filter  with  Floating  Clock  Electrode  Sensor 
and  Variable  Tap  Gain,'  ISSCC  Technical  Digest,  February  1976, 
pp.  194-195. 
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Figure  14.  Floating  Clock  Electrode  Sensor  Circuit 

is  to  provide  a buffer  for  the  MOSFET  pair  and  serve  as  a voltage  source 
for  the  tap  we  ght  connected  to  the  emitter. 

To  achieve  interchannel  isolation  , eliminate  nonuniformities  caused 
by  the  input  circuit,  and  increase  the  spacing  between  tap  points,  a ' refer- 
ence or  a-c  zero'  is  interlaced  between  successive  signal  samples.  In  an 
off-chip  analog  reconstruction  circuit,  consisting  of  a summing  amplifier 
and  a clamp/sample  circuit,  the  voltage  corresponding  to  the  reference  is 
clamped  and  the  sample  operation  is  performed  on  the  ' reference  t signal' 
voltage.  As  the  clamp/sample  sequence  performs  a differencing  operation, 


T.  F.  Cheek  Jr. , J.  B.  Barton,  S.  P.  Emmons,  J.  E.  Schroeder,  and 
A.  I . fasch  .1  r.  ' Design  and  Performance  of  Charge-Coupled  Device 
lime  - Division  Analog  Multiplexers,’  1 1 1 7 3 Proceedings  of  CCD  Appli- 
cations ( (inference,  September  1973,  pp.  127-139. 
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the  output  of  the  reconstruction  circuit  does  not  reflect  offsets  caused  by 
the  input  circuit  or  crosstalk  between  successive  signal  samples.  In  the 
lower  trace  of  figure  1 5 is  the  emitter  waveform  showing  the  output  of  the 
PC  I S circuit  corresponding  to  the  1 reference1’  and  ' reference  4 signal.' 

I igure  1'  is  a photomicrograph  of  a SI/PO  CCD  chip  using  the  FCES  output 
circuit  at  each  tap  location. 

4.  3 TRANSVERSAL  FILTER  UTILIZING  THE  FCES  OUTPUT  CIRCUIT 
The  harmonic  content  for  a single  tap  was  measured  under  the  following 
conditions 


f , 50  kHz 

clock 

^sample  clock/2 


25  kHz 

f . ,1  kHz 

signal 

Tap  weight  5 kil  fixed  resistor 

V.  IV  peak -peak 

input 

Less  than  0.  3 percent  (-50  dB)  total  harmonic  distortion  was  measured  for  a 

1.  2 volt  variation  of  the  dc  bias  on  the  G2  electrode^  used  in  the  stabilized 

7 1 , 72 

charge  injection  input  method 


C.  H.  Sequin  and  A.  M.  Mohsen,  "Linearity  of  Electrical  Charge  Injection 
into  Charge- Coupled  Devices,"  IEEE  ,1.  Solid-State  Circuits,  SC  - 1 0, 

April  1975,  pp.  81-92 

*S.  P.  Emmons  and  D.  D.  Buss,  ' Techniques  for  introducing  a Low-Noise 
at  Zero  in  CCD's,  ' Device  Research  Conference,  June  1973,  Boulder, 

Colo  rado 
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M.  H.  Whife,  D.  R.  I.ampe,  J.  L.  Fagan,  "CCD  and  MNOS  Devices  for 
Programmable  Analog  Signal  Processing  and  Digital  Nonvolatile  Memory,  " 
1EDM  Technical  Digest,  December  1973,  pp.  130-131. 
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Figure  16.  Phof-omic rog raph  of  SI/PO  CCD  Chip 


Figure  17  shows  the  impulse  response  of  a 20  tap  SI/PO  CCD  with  the 
faps  weighted  according  to  a Hamming  function.  Each  resistor  value  is 
determined  by 


(71) 


where  R k is  the  resistance  value  of  the  n tap  location,  W ^ is  the  Hamming 
weighting  coefficient  given  by 


W 


k 


0.  54  - 0.  46  cos 


27(k-l) 

N-l 


1 < k<  N 


(72) 


and  R is  the  resistance  value  of  the  center  tao(s).  The  individual  resistors 

o 

are  selected  to  within  ±1  percent  and  the  gain  variations  are  within  ±3  per- 
cent without  trimming.  Figure  17  also  shows  the  frequency  response  of  >-he 
filter  with  tap  weights  untrimmed. 


5.  MOS  TRANSISTORS  AS  ELECTRICALLY  REPROGRAMMABLE 
ANALOG  CONDUCTANCE  ADAPTIVE  FILTER  WEIGHTS 


Historically,  there  lias  been  many  attempts  to  realize  variable  analog 

weights  for  the  adaptive  filter.  One  of  the  earliest  was  the  motor-driven 

7 3 _ 74 

potentiometer  of  servo-mechanisms.  A photo-optic  device  was  used 

where  fhe  transmittance  decreased  on  exposure  to  yellow  light  and  reading 

7 5 y (j 

was  performed  with  red  light.  Other  devices  ’ which  were  essentially 

electrochemical,  were  employed  with  limited  success.  The  meniistor^ 

was  an  interesting  concept  in  which  the  passage  of  an  electric  current  through 

a chemical  solution  resulted  in  the  plating  or  deplating  of  a conductive 

electrode  weight.  In  order  to  be  compatible  with  electrical  delay  lines,  the 

prog ra.  unable  weight  should  be  electrically  controlled.  This  was  discussed 

77 

in  connection  with  fe r rielectric  structures  and  later  with  respect  to  MIS 
transistors  with  a Ferroelectric  gate  material.  Ferroelectric  materials 
are  difficult  to  prepare  and  the  control  of  their  properties  in  an  integrated 


F.  . Hey,  ’ The  Mark  I Perceptor,  Design  and  Performance"  IRE  Nat'l. 

C<  v.  Rec, , Pi.  2,  New  York  (I960) 

S I.  Campur,  "Self-Organizing  Networks'  , Armour  Research  Foundation 
Illinois,  Institute  of  Technology,  Armour  Rep'tE154,  Chicago,  111.(1962) 

exas  Research  6 Electronics  Co  rp.  "An  Introduction  to  Solions"  Dallas, 
Texas,  June  1961. 


76  , 

An  Adaptive  Adaline  Neuron  Using  Chemical  Memistors,  " Stanford  Elec- 
1 ronic  Labs.  Tech  Rep't  1953-1,  Stanford  University,  Oct.  I960. 

77 

C.  F.  Pulvari,  " Fe  rroelectrics  and  their  Applications  in  Solid-State  Devices 
and  in  Adaptive  Control,  " Proc,  1963  Bionics  Symp. 
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circuit  structure  is  extremely  difficult.  In  1966,  Szedon  discussed  the 

charge  instability  under  electrical  stress  in  a silicon  nitride  (SigNa) /silicon 

dioxide  (SiO  1 dual  dielectric  structure  and  Wegener  described  the  potential 
*"  79 

of  a MXOS  nonvolatile  memory  transistor  . Since  these  early  papers,  a 
number  of  papers  have  appeared  in  the  literature  with  regards  to  the  MNOS 
memory  transistor  . The  MNOS  memory  transistor  may  be  used  as  a 
digital  nonvolatile  store  in  memory  arrays  or  as  an  electrically  reprogram- 
mable analog  conductance.  In  order  to  use  this  latter  property,  the  MNOS 
must  be  operated  in  its  triode  region  similar  to  a MOS-FET  voltage-control- 
led conductance. 

5.  1 MOS  TRANSISTORS  WITH  BIDIRECTIONAL  CCD  CONTROL  OF  WEIGHTS 

The  MOS  transistor,  when  operated  in  its  triode  region,  displays  an 

analog  conductance  between  drain  and  source  g , which  is  electrically  alter- 

ds 

able.  The  d rain-to- source  conductance  for  small  drain-to-source  offset 
voltages  is  given  as: 


g 


ds 


(73) 


where  (3  is  a geometry  and  material  parameter,  V the  applied  ga'e-to- 
source  voltaee,  and  V the  intrinsic  threshold  voltage  of  the  device.  There 
are  two  methods  by  which  the  conductance  can  be  altered: 

(1)  variable  V with  V fixed 

OS  I 

(2)  fixed  V__  with  V_  variable 

C xS  1 


' H J.  R.  Szedon,  'Charge  Instability  in  Metal /Silicon-Nit  ride  /Silicon- Dioxide  / 
Silicon  Structures,1  IEEE  Solid-State  Dev.  Res,  Cond.  Evanston,  111. 

June,  1966. 

7 *H.  A.  R.  Wegener,  et.  aj.  , "The  Variable  Threshold  Transistor,  a New 
Electrically  Alterable  Nondestructive  Read  Only  Storage  Device,  " 1976 
IE  1 )M,  Washington,  I).  C. 

^ See  the  review  paper,  J.  Chang,  "Nonvolatile  Semiconductor  Memory 
Devices"  Proc.  [FEE,  G4,  1033  (1976). 


We  will  discuss  the  firs!  method  in  this  section  and  leave  the  variable 
threshold  voltage  approach  to  the  MW  OS  memory  transistor  which  is  treated 
in  Section  5.  2. 

The  MOS  transistor  is  to  be  used  as  the  basic  analog  conductance  multi- 
plier, whether  it  is  method  1 or  2 above,  and  figure  18  illustrates  the  attach- 
ment of  this  device  to  the  CCD  delay  line.  The  delayed  analog  signal 

th 

u X (t  - kT),  where  t mT  at  the  m clock  time,  is  applied  across  the 
k 

drain  to  source  regions  of  a MOS  transistor.  The  control  voltage,  which 
sets  the  conductance  for  analog  weighting,  is  applied  between  the  gate  and 
source  regions.  The  output  voltage  V ^ is  proportional  to  the  delayed  input 
signal  and  given  as: 


V 


out 


R„  g,  a.  X (m-k)T 
F ds  k 


(74) 


th 


where  a is  the  gain  associated  with  the  k tap  on-chip  FCDS  circuit.  Since 
k 

♦ he  MOS  analog  conductance  has  a limited  V which  can  be  applied  prior  to 

Q S 


Figure  18.  MOS  Voltage-Controllable  Analog  Conductance  for 
Adaptive  Tap  Weight  Element 
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2nd  order  distortion  effects,  if  is  instructive  to  consider  a comparison 
between  a fixed  resistor  weight  and  a MOS  transistor  voltage-controlled 
conductance  weight.  Figure  19  illustrates  <he  output  observed  on  a spectrum 
analyzer.  We  can  achieve  less  than  1 percent  nonlinearity  if  the  peak-to- 
peak  tap  signal  does  not  exceed  0.  2\'  and  tire  operating  point  has  less  than 
± 0.  IV  offset  from  V ^ 0.  Thus,  it  is  important  to  maintain  the  proper 

bias  point  operation  for  all  the  MOS  transistors  in  an  array. 

In  order  to  achieve  a variable  V we  may  convert  the  error  to  digital 

CiS 

form  with  an  A/D  conver'er,  achieve  storage  and  accuracy  with  accumulators 

and  finally,  the  m duplication  with  a multiplying  digital -to-analog  converter 

(MDAC).  There  is  certainly  mt  too  much  appealing  with  this  approach  as 

the  complexity  of  the  adaptive  filter  is  increased  enormously  together  with 

size  and  power  dissipation  which  is  reflected  in  cost.  An  8-fap  weight 

H () 

system  has  been  built  with  this  approach  to  perform  adaptive  linear  pre- 
diction with  the  I. \1S  algorithm;  however,  the  delay  lines  were  lumped  L-C 
type  with  different  dispersive  characteristics.  A different  approach,  which 
deserves  considerable  merit  and  is  compatible  with  CCD  technology,  is 
♦lie  use  of  bidirectional  stabilized  charge  injection  to  increment  or  decrement 
analog  signal  charge  onto  the  node  of  a MOS  transistor.  This  concept  is 
illustrated  in  figure  20  with  voltage  adjustment  accomplished  by  means  of 
('.CD  bidirectional  charge-control.  The  analog,  scaled,  error  signal 
2g  I e I is  applied  to  a CCD  storage  or  holding  well  whereas,  the  control 
signal  *o  increment  or  decrement  charge  determines  the  function  of  the 
G and  G.,  electrodes.  The  charge  increments  are  converted  to  voltage 
increments  as  follows; 


D.  R.  Morgan  and  S.  K.  Craig,  "Real-Time  Adaptive  Linear  Prediction 
I sing  ♦he  Least  Mean  Square  Gradient  Algorithm,'  IEEE  Trans,  on 
Acoustics,  Speech  and  Sig.  1‘ruc, , ASS1  ‘-24,  494  (1976). 
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a.  Fixed  Resistor  R 5kii 
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Spectral  Components  of  SI/PO  Single  Tap  Output 

= N Channel  MOSFET  Biased  for  5 KlZ  Resistance 
Vin  = IV  p p at  1 kHz 

f sample  * 20  kHz  76-osi7-vA  . 

b.  MOS-FET  Analog  Conductance  R bksi 

Figure  19.  MOS-Transisto  r Analog  Conductance  Comparison 
with  Fixed  Resistor  Performance 
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a.  Simplified  Concept 


2 (J  t 


7?  Of>81  V 10 

1).  ( C O Implementation 

I i l'  u re  -0.  Iddirertion.il  i ha  me  ( onfrol  for  Adjustment  of 
Volta  , t o Ai  liieve  a Variabli  Analog  MOS  (Conductance 


i 

I 

f 


t 


c 


< 


q_ 

c 


c 

II 

c 


<751 


This  technique  can  provide  gain  through  the  selection  of  the  holding -well 
capacitance  (Cj^)  area. 

5.2  METAL -XI 1 RIDE -OX  IDE -SI  LI  CON  (MNOS)  ELECTRICALLY 
REPROGRAMMABLE  ANALOG  CONDIfC TANCE  WEIGHTS 

ITie  metal-nitride-oxide-silicon  (MNOS)  nonvolatile  memory  transistor 

is  the  electrostatic  analog  of  the  magnetic  co . <■  storage  element.  Memory 

is  achieved  in  the  MNOS  transistor  by  electrically  reversible  tunneling  of 

charge  from  the  silicon  semiconductor  to  deep  traps  near  the  SiO_/Si  X, 

2 3 4 

interface  in  a thin  SiO?  (i.e.  typically  20AM  structure.  Figure  21  illustrates 

a photomicrograph  of  a drain-source  protected  (DSP)  MNOS  memory  tran- 

8 1 

sistor.and  figure  22  shows  a cross-section  of  the  DSP  geometry.  The 
thicker  oxides  over  the  drain  and  source  regions  protect  these  regions  from 
electrical  and  mechanical  stress  in  addition  to  limiting  the  mode  of  opera- 
tion to  the  enhancement  mode'  . One  of  the  important  advantages  of  this 

82 

geomefry  is  the  extended  endurance  of  MNOS  memory  transistors  under 

1 2 

prolonged  cycling  with  one  ration  beyond  10  erase/write  cycles. 


8 1 

J.  R.  Cricchi,  et.  al.  , The  Drain-Source  Protected  MNOS  Memory 
Transistor',  1073  [EDM,  pg.  12t,  Washington,  D.  C. 

8 ^ 

“M.  H.  White,  J.  W.  Dzimianski,  M.  C.  Peckerar,  ' Endurance  of  Thin- 
Oxide  Nonvolatile  MNOS  Memory  Transistors'  , IEEE  Trans.  Elec  tron  Dev.. 
ED-24  577  ( 1 077). 
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The  programming  voltages  ±Vp  result  in  a - and  4 stored  charge  Qj 
located  near  the  SiC^/Si^  interface  with  a change  in  device  threshold 
voltage  given  by  the  expression, 

-X  2SQ  (76) 

AV  u 

th  Kx  o 

where  X is  the  Si.X  , thickness.  K the  Si  X relative  dielectric  constant, 
and  N Q the  shift  jn  interface  charge  under  a programming  pulse.  The  ^ 

change  in  threshold  voltage  may  be  written  in  terms  of  device  parameters. 

ivlh  ' Vt(!  -t)  ln  ('  '*) 

where  V is  a characteristic  tunneling  threshold  voltage,  CQ  and  C^.  are 
the  oxide  and  nitride  capacitances,  * the  programming  pulsewidth,  and 


(C  4 C ) 

V_  o 

T T~x— 


-V  /V 
o I 


where  J { is  a p re -exponential  oxide  tunnel  current  term  and  Vq  the  initial 

voltage  drop  across  fhe  thin  oxide  region. 

The  charge  in  conductance  of  the  MXOS  memory  transistor,  operating 

in  i * s t riode  region,  is  given  as, 


l,  h 
ds  p 


,CoS  \ 

AV  , 

p AV 

iCo+CN  / 

th 

\v 

_ V given  by  equation  (77).  In  order  to  relate  the  applied  gate-to-source 
th 


Svl.  H.  White  and  .T.  R.  Oricchi,  "Characterization  of  Thin-Oxide  MXOS 
Memory  transistors."  IEEE  Trans.  Klee.  Dev.,  ED-19,  1280  (1972) 
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prog ramming  voltage,  V , 
division  to  obtain. 


to  the  oxide  voltage  drop,  we  use  capacitance 
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and  'lie  l ondu  'ante 


"ds 


(3  (V 
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' v di1 
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whe re  V 

I\ 


is  'lie  read  voltage  which  is  selected  such  tha‘  negligible  program- 


mine  of  'he  MX  OS  structure  occurs. 

s.  3 CALC.'  LATIOX  OF  2p  ^ FOR  i'HE  CLIPPED  DATA  LMS  ALGORITHM 
Figure  23  illustrates  a block  diagram  of  a single  MXOS  weight  connected 
to  a CCD  delay  line  a*  'he  k tap  position.  The  object  of  this  analysis  is 
'o  calculate  'he  effective  convergence  fac'or  2p  which  appears  in  ‘he  l.MS 


I Lure  23.  Simplified  Block  Diagram  of  MNOS  Analog 
( iorvl  1 1 f a n < <*  I ' ro l'  rati  it ni  ni*  Operation 


algorithm.  In  order  to  do  this  we  will  use  the  preceding  equation  in  sec 
tion  5.  Thus,  from  equation  (Hi)  we  mu\  write 


g (m  -1  g . (ni  - 3 A\  i I < 
d s , d s 

k k 


w here 


AY  , (T)  V (mT  ) - V [(m-111  ] 


k d s , 

k 

\V,(m*li  W (ml  t-  R G Ag  (m) 
k k F dsk 

"Vm|  ‘^eff  C SC1"  ['  k'"1] 


Thus,  we  have 


2^eff  RFG  9 


( Ag , (m)  \ 

i dsk  ) 


(iV,h(T|) 

P RpC  9 7^ 


Combining  equations  (77),  (7Hifand  (HOi  with  \ ■■•■t  viehi: 


(t  T ) 

0 A R G — 12 

' F 1 -t  r 
P 


which  illustrates  the  variation  of  2p  with  t t . I his  variation  is  actually 

el  t p 

a dependence  on  the  error  e which  determines  t through  equations  ( i S)  and 

(HO).  Thus,  below  a minimum  error  determined  by  t T 1,  the  2p  ^ _ is 

exponentially  dependent  upon  the  error  whereas,  when  the  error  is  above  this 

minimum  2p  . is  independent  of  the  error  - analogous  to  a forward-biased 
eff 

P-N  junction  diode.  This  type  of  limiting  action,  in  which  the  p becomes 


L-  1 1 


anishinglv  small  below  a minimum  error,  may  nullify  the  so-called  mis- 
rtdiustment  error  * described  in  connection  with  equation  (20)  at  the 
■xpense  of  s\  stem  response.  I he  range  of  2p  may  be  extended  to  smaller 

i rrers  by  increasing  the  gain  A;  however,  there  is  a practical  limit  to  due 

ii  axim’im  gain  based  on  input  signal  amplitude.  I bus,  AGC  of  the  input 
signal  i r error  would  appear  to  be  the  best  approach  to  extend  the  dynamic 
ra  ng  e. 

.4  SPEED  OF  RESPONSE  AND  PROGRAMMING  VOLTAGE  RANGE  FOR 

MNOS  ELECTRICALLY  REPROGRAMMABLE  ANALOG  CONDUCTANCE 
WEIGHTS 

The  speed  of  response  is  a function  of  the  amplitude  of  the  programming 
.oliagt  (i.e.,  the  magnitude  of  the  error),  the  pulsewidth  t . and  the  initial 
-Mate  i>:  ;2p|e|  stored  charge  in  the  MNOS  device.  Equation  (77>  incorporates 
11  of  these  effects  into  a single  expression  from  which  we  may  draw  the 
following  conclusions: 

(1  AW  AY  , constant  x log,,,  t 

th  10  p 

where  the  constant  is  typically  2 volts  decade  for  t^‘-T 

(2)  AW  AV  , 2pAe 

th 

with  the  change  of  threshold  proportional  to  a change  in  the  error 

for  t ~ . 

P 

: igure  24  illustrates  a set  of  response  curves  for  a p-channel  MNOS 
■ i r\  transistor.  The  electric  field  strength  across  the  thin-oxide 
- di-tern  i tied  by  the  nitride  thickness,  and  it  is  important  to  control  this 
; r un*  ter  ,n  the  processing.  Figure  25a  illustrates  a set  ot  4 MNOS  devices 
with  controlled,  uniform,  nitride  thickness  while  figure  24b  shows  a set  ot 
1 V .<  S devices  with  nonuniform  nitride  thicknesses.  1 hese  measurements 
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Figure  24.  P-Channel  MNOS  Memory  Transistor  Erase/Write 
Characferisfics  (Single  Pulse  Response  from  a Saturated  Sfate) 
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Figure  25.  Uniform  and  Nonuniform  Characteristics  of 
MNOS  Memory  Transistors  (1  300psec)  X 4r0°A°,  v 20/ 


are  taken  on  a Macrodata  MD154  computer -controlled  tester  which  uses 

read  voltages  in  a dinars  search  routine  to  determine  the  transistor 

state  voltage  when  1^  lOpA.  The  thick-oxide  threshold  voltage  V ^ 

-2.5V  sets  the  limit  for  high  conductance  while  the  threshold  may  be  changed 

to  a maximum  of  -11.4V  for  this  particular  device.  In  operation,  the 

read  voltage  is  tvpically  V -8B  to  give  a reasonable  conductance  dynamic 

range.  For  p-channel  MNOS  transistors,  a negative  programming  -voltage 

(i.e.,  -2pe  I wdll  cause  u positive  increment  in  charge  to  be  stored  in  the 

device  (AQ^  0)  and  a negative  shift  will  occur  in  the  threshold  voltage 

f see  equation  (7-  m,  thereby,  decreasing  the  drain-source  conductance  g , 

ds 

for  a fixed  read  voltage  applied  between  gate  and  source  [see  equation  (81 )]  . 
A positive  programming  voltage  (i.e.,  f2pe  ) will  remove  the  stored  positive 
charge  and  'end  fo  accumulate  negative  charge,  thereby,  decreasing  the 
threshold  voltage  and  shifting  it  in  a positive  direction.  For  a fixed  read 
voltage,  the  conductance  will  increase  under  a positive  (erasel  programming 
voltage.  Tlie  speed  of  response  and  voltage  programming  range  are  deter- 
mined by  the  nitride  thickness  as  figure  26  illustrates  a thinner  nitride  of 
X 335A°. 

5.  5 MNOS  CHARACTERIZATION  FOR  ADAPTIVE  WEIGHT  CONTROL 
Figure  27  illustrates  the  basic  circuit  used  to  characterize  an  MNOS 
device  for  *he  adap'ive  filter.  The  circuit  incrementally  writes  and  clears 
‘he  MNOS  device  by  applying  a voltage  staircase  to  the  gate.  For  a p- 
channel  MNOS  FET,  the  staircase  is  positive  going  for  fhe  clear  mode  and 
negative  going  for  the  write  mode.  Tlie  offset  of  the  staircases  can  be 
regulated  between  ground  and  ±20Vdc.  To  measure  the  ac  conductance  of 
the  MNOS  device,  a read  voltage  is  applied  after  each  program  s'ep  when 
a sinusoid  is  applied  to  the  drain.  After  eight  "write  clear"  sequences,  the 
device  is  saturate  "cleared1  by  applying  a '20V  pulse  to  (lie  gate. 
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Figure  26.  P-Channel  MNOS  Memory  Transistor  Erase/Write 
C:ha  ract-e  ristics  (Single  Pulse  Response  from  a Saturated  State) 


The  at  signal  is  generated  by  applying  a 50  percent  duty  cycle  square 
wave  from  a pulse  generator  info  an  LC  resonant  circuit,  By  strobing  fhe 
p .lse  generator  with  a ' sync''  probe  from  *he  mas*er  clock  pulse  generator, 
we  are  able  to  synchronize  the  sinusoid  with  the  systems  timing.  With  a 
small  a«.  signal  applied  ‘o  'he  MXOS  drain,  'he  amplitude  will  vary  during 
each  read'  cycle  due  to  incremental  threshold  voltage  shifts  ( i.  e.  , channel 
conductance  increase  and  decrease)  for  a given  read  voltage  and  series  of 
write /clear  ramps.  We  can  therefore  determine  voltage  levels  necessary 
*o  opera'e  'he  MXOS  as  an  adjustable  weight  in  an  adaptive  processor. 

The  upper  trace  of  figure  28  shows  the  operational  amplifier  output 
voltage  when  the  signal  shown  in  the  lower  trace  is  applied  to  'he  ga'e  and  an 
0.  5 V pp  signal  is  applied  fo  the  drain.  The  saturate  clear  se's  the  conduc- 
tance of  the  device  to  its  highest  state.  The  conductance  then  decreases 
when  a write  ramp  is  applied.  After  16  incremental  write  s'eps,  the  MXOS 
is  incrementally  cleared  with  a positive  going  ramp.  The  rate  of  change  of 
the  conductance  is  a func'ion  of  'he  dc  levels  of  the  ramps,  the  read  voltage, 
and  ini'ial  threshold  levels  as  a ramp  begins.  The  read  voltage  atid  pulse- 
width  must  be  minimized  to  avoid  the  read-disfurb  effects  since  the  read 
voltage  is  in  the  direction  to  write  the  device. 
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Figure  28.  MNOS  Characfe rization  Circuit  Output  Pulsewidth 

t 200psec  for  Write  and  Clear  Saturate  + 20V  0 Read  -9Volts 
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6.  ADAPTIVE  FILTER  BREADBOARD  AND 
E X PE  R IMEN  T A L CHARACTER  1ST  ICS 


I he  purpose  of  the  adaptive  filter  breadboard  is  to  demonstrate  the 
feasibility  of  implementing  the  I. MS  algorithm  in  an  integrated  circuit.  In 
order  to  accomplish  this  task,  the  components  of  the  breadboard  must  be 
compatible  in  the  integrated  circuit  sense.  The  breadboard  described  in 
this  section  uses  the  "clipped  data"  LMS  algorithm  and  the  basic  linear 
combiner  is  constructed  with  a CCD  analog  delay  line  and  electrically 
reprogrammable  MNOS  analog  conductance  weights.  Other  techniques  could 
have  been  employed  such  as  the  bidirectional  charge-control  method  to 
provide  a variable  gate  voltage  on  a MOS  analog  conductance;  however,  the 
availability  of  MNOS  memory  transistors  and  the  potential  for  long-term 
analog  storage  with  this  device  structure  made  this  a convenient  approach, 
f igure  29  illustrates  a block  diagram  of  the  CCD  adaptive  filter  and 
figure  30  is  a more  detailed  description.  The  voltage  output  at  each  tap, 
denoted  by  X and  X,,  is  multiplied  by  the  MNOS  conductances  at  each 
tap  location.  I he  resulting  currents  are  converted  to  voltages  by  amplifiers 
1 and  2.  The  voltaite  output  of  amplifier  1,  donated  by  Y , is  given  by; 

Yl=-Rf'WAX1+WCX2) 

W = g , I MNOS  A (871 

A 'ds  ' 

W = g , | MNOS  C 
C ds1 

Likewise,  the  voltage  output  of  amplifier  2,  denoted  by  Y , is  given  by; 

Y2  -Rf  (WB  X1  + WD  X2)  (88' 

Therefore,  depending  on  which  weights  are  used,  and  Y 7 can  be  used  to 

determine  the  characteristics  of  the  MNOS  weights  and  to  correlate  theoretical 

predictions  with  experimented  results  after  adaptation  is  completer). 
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Figure  30.  Adaptive  Filter  Block  Diagram 


I'he  output  of  amplifier  3,  deonted  by  Y.;  is  given  by: 


Y. 


Y„  - Y 


-KRf  t,wn 


wa’  x, 


(W  - W ) X_  ] 
D C 2 J 


(89 ) 


where  K is  'he  gain  associated  with  amplifier  3(  2).  From  equation(89)  it 

can  be  seen  that  both  positive  and  negative  effective  weighting  can  be  realized 

by  the  relative  magnitude  of  (\V  and  W ) and  (W  and  \V„ ).  The  voltage  Y„ 

T)  A D C 3 

is  applied  to  a clamp  sample  circuit  to  difference  the  a-c  zero  and  (signal  + 
a-c  zero)  formatted  signal  to  retrieve  the  signal  without  causing  a d-c  level 
bounce  in  the  system  during  the  adaption  process.  The  clamp  sample 
output  voltage  is  filtered  by  a low-pass  filter  with  a notch  at  the  sample 
frequency.  I'he  filter  output  is  a continuous  time  waveform  which  may  be 
further  amplified  without  amplifying  the  noise  associated  with  aliasing  and 
switching  spikes  inherent  in  a sampled-data  signal. 

I'he  linear  predictor  output,  y(t),  is  subtracted  from  the  desired  signal, 
d(t),  which  is  also  a continuous  time  signal.  The  difference  or  error,  given 
by, 


e (t)  = d(t ) - y (t ) (90) 

is  applied  to  a full  wave  rectifier  to  form  the  absolute  value  of  the  error.  ( c J 
is  amplified  and  d-c  level  shifted  to  form  +2p|t|  and  -2p| e|  w hi  c h are 
unidirectional  a-c  signals  superimposed  upon  a "no  program  level.  The 
voltages  ±2p|e|  are  directed  to  the  MNOS  gates  by  the  steering  network, 
which  is  controlled  by  the  "exclusive  OR  circuits.  The  exclusive  OR 
output  is  determined  by  sgn  [ < (in)  ] and  sgn  [X  (m-k)J  as  processed  by  the 
initialization  circuit.  It  will  be  noted  that  since  the  error  is  in  continuous 
time,  the  weight  for  tl  <■  next  clock  period  (m  + 1)  is  determined  by  sgn  [<  (m)  ] 
and  j 1 tm)  | iu9t  before  the  update  mode  terminates.  However,  it  is  assumed 
the  error  change  is  slow  compared  to  the  update  time.  The  signals  into 
the  initialization  circuit  and  exclusive  OR  circuit  update  the  weights 
according  to  the  format  shown  in  table  1. 
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IABI.E  1. 


SI  H WRING  NETWORK  UPDA  IK  ALGORITHM 


sgn  X 


l-k 


sgn  (t) 
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0 

1 

0 

1 


incremental  clear  (conductance  increase) 
incremental  write  (conductance  increase) 


W 


D 


! 
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The  "clipped  data"  I. MS  algorithm  employed  in  the  adaptive  filter  is  given  by 
the  expression: 

W,  (m  + 1 ) W.  (m)  + 2u€  (m)  sgn  e (m)  sgn  X(m-k)  (q  1 1 

k k 

The  weights  associated  with  the  taps  are  given  as, 


\V„  = W - V/ 

2 D C 

Figure  31  illustrates  a timing  diagram  for  the  adaptive  filter  and  figure  32 
i*-  a photograph  of  the  analog  processor  board.  The  clock  waveforms  for  the 
SI  PO  CCD  operation  were  discussed  in  section  4.2.  The  additional  timing 
pulses  are  required  to  perform  clamp  and  sample  in  the  analog  processor 
y(t)  reconstruction  circuit,  strobe  of  sgn  X and  sgn  e , operation  of  the 
digital  shift  register,  and  the  read  update  mode  selection  as  indicated  in 
figure  31. 
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imin^  Diagram  for  .Si  PO  CCI  Adaptive  T-  ilte 


Figure  32.  Analog  Processor  Adaptive  Filter  Breadboard 


».  1 COMPU  TER  SIMULA  TION  - TWO  TAP  LINEAR  ADAPTIVE  FILTER 
Figure  33  illustrates  the  configuration  used  to  simulate  a 2- tap  adaptive 
linear  filter  where  the  weights  are  updated  according  to  equation  CM)  shown 
in  figure  30.  lable  2 shows  the  results  of  computer  simulation  in  which 
the  weights  are  updated  in  accordance  with  various  combination  of  control 
signals  from  the  steering  network.  It  will  be  noted  that  if  the  weights  are 
upda'ed  according  to  configuration  4,  which  is  the  configuration  used  on  the 
breadboard  and  corresponds  to  table  1,  a linear  predictor  can  be  implemented 
by  using  1,  2,  3,  or  4 weights  with  the  constraints  indicated  in  table  3. 
Therefore,  by  constraining  the  phase  between  y and  d,  restricting  ’he 
weights  used  so  that  y^  and  y,  each  reflect  only  one  weight,  (not  an  effective 
weight),  the  values  of  individual  weights  after  adaptive  can  be  determined  and 
compared  to  theoretical  prediction. 

...  2 E \ PE  RIM  KN  TAL  RES''  LTS  FOR  2-  1 AP  LINEAR  A PAP  ITVE  N TCH 
FILTER 

f igure  34  shows  the  y and  d channels  during  initialization  for  tne  case 

where  2 weights  (V\  V ^ - W are  used  at  tap  1 and  2 weights  ( 4 ) 

W,  - W(  ) are  used  at  tap  2.  Figure  34  shows  the  y and  d channels  after 

adaptation.  After  adaptation,  the  component  of  d in  that  error  is  reduced 

by  25  flB.  f igure  35  shows  the  voltage  at  y^  and  y_>t  respectively,  during 

ini  ‘ ia  I j rat  ion,  where  W and  W are  saturate  written  (g,  0)  and 

A C,  d s 

\\  and  V saturate  cleared.  Figure  35  shows  the  corresponding  y 
1 i I 1 

and  y,  waveforms  after  adaptation,  where  \V  and  W , have  changed  to 
produce  voltage  outputs  which,  when  subtracted  by  amplifier  3 and  further 
pro<  cssed  by  the  i lamp  sample  circuit,  etc.  , forms  a y which  attempt  to 
minin  \s<  'he  difference  between  y and  d in  the  mean  square  sense. 

I igure  3t  illustrates  he  experimental  results  ob'ained  on  the  adaptive 

J 85 

filter  with  2 weights  tap.  1 he  adaptivity  is  defined  as 

adapticity  20  log  10  (~)  (9  3) 

u c 

R.  Riegler  and  R.  Compton,  Jr,.  "An  Adaptive  Array  for  Interference 
Re  jection",  Pr oc  . I E 1 . K,  (.1,  74H  (197  3). 


.,-K 


Figure  33.  Iwo  Tap  Adaptive  Linear  Predictors 


Adaptation 
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Horizontal  2ms/Div 
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Figure  34.  I wo  l ap  Adaptive  Linear  1 ilter  Output 
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Figure  35.  Two  lap  Adaptive  Linear  Filter  Components  Waveforms 

(2  Weight/Tap) 


s on  'clipped  data"  I. MS  Algorithm 
Adaptive  Notch  Filter 


1 ABLE  3. 


PHASE  TRACK  CAPABILITY  FOR 
VARIOUS  WEIGHT  CONFIGURATIONS 


Number  of  Weights 


Amplitude  Range 


Range 


Note:  0 corresponds  to  y for: 


W 0 
A 


W I 

B 


W 0 
D 

X don't  care 

1 weight  normalized  to  saturate  cleared  state 
0 saturate  written  state 


and  we  notice  the  rejection  improves  in  the  II  and  IV  quadrant  as  discussed 
tn  connec'ion  with  figure  9.  The  measurements  were  performed  for  the 


two  cases; 

W2  ’ 

as  initial  states  prior  to  adaptation.  Essentially,  the  results  are  unchanged 
with  respect  to  the  choice  of  initial  tap  weight  setting.  The  final  value  for 
the  tap  weights  is  given  by  equation  44  in  the  absence  of  noise 

d 

V.  ( opt.  ) — cos  <t> 

' YP 

W (opt.  ) — sin  «i  1 Q M 

yo 

I he  experimental  and  theoretical  valves  agreed  to  within  1 to  3 percent,  the 
measurement  accuracy,  and  varied  in  accordance  with  amplitude  and  phase 
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as  predicted  by  t h < ■ Wiener  solution,  A value  of  p - 0.  15  was  used  in  these 
measurer  ents.  I he  transient  response  of  the  error  as  a function  of  p is 
illustrated  in  figure  57.  As  noted  in  section  3,0,  the  transient  response  is 
experimentally  dependent  upon  p and  this  has  been  verified  in  experiments 
as  shown  in  fissure  37. 

F'igure  38  illustrates  two  experimental  setups  to  examine  the  CCD  adaptive 
filter  as  a notch  filter  for  noise  or  interference  cancellation.  In  this 
configuration,  a 50  Hz  desired  signal  was  corrupted  by  a 250  Hz  interference 
signal,  where  the  latter  is  15  dB  larger  than  the  former  prior  to  adaptation. 
The  error  is  monitored  and  the  adaptation  illustrates  a 32  dB  rejection  in  the 
interference  which  brings  the  desired  signal  16  dB  above  the  interference. 
Figure  39  illustrates  the  output  waveforms  before  and  after  adaptation 
in  the  time  domain. 
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Figure  37.  Transient  Response  of  IMS  Algorithm 


Before.'  Adaptation 
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After  Adaptation 
(b) 
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Figure  Vf.  ( utpu'  Wavdornis  of  Adaptive  Noise  Canceller 
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7.  APPLICATIONS 

There  are  a number  of  applications  for  adaptive  filters  with  special  need 
for  real-time  signal  processing.  Several  applications  are; 

• Estimation  Prediction  • Echo  Cancellation 

• Filtering  • Speech  Analysis 

• Spectral  Analysis  • Noise  Cancellation 

• Data  Compression  • Coherent  Signal  Processing 

• Interpolation  • Frequency  Measurement 

• Multiple  Linear  Regression  • System  Modeling 

7.  1 ADAPTIVE  NOISE  CANCELLATION 

A very  important  application  area  is  adaptive  noise  cancelling  such  as 
the  removal  of  interference  in  electrocardiography,  noise  in  speech  signals, 
clutter  cancellation  in  antenna  (or  similar  type  systems  with  hydrophones, 
seismic  acoustic  transducers,  electro-optical  sensors,  etc.  ) sidelobe 
interference  and  coherent  signal  processing  when  periodic  signals  must  be 
separated  from  broadband  interference  such  as  spectrum  systems.  Figure 
40  Ulustra'es  the  application  of  adaptive  noise  cancelling  to  electrocardio- 
graphy. Cancellation  of  60  Hz  interference  in  conventional  ECG,  the  donor 
ECG  in  heart  transplants,  and  the  maternal  ECG  in  fetal  electrocardiography 
Figure  38  in  section  6.  0 demonstrated  the  use  of  a 2-tap  adaptive  noise 
canceller  to  reject  the  interference  of  a single  frequency.  The  advantage 
of  this  technique  is  the  cancellation  of  the  interference  even  when  the 
latter  drifts,  since  the  reference  input  to  the  filter  will  also  drift. 
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ADAPTIVE  NOISE  CANCELLER 
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Figure  40.  60  Hz  Interference  Cancellation  with  a 

2-  l ap  Adaptive  Filter  in  Klectrocardiography^ 

A second  area  is  the  cancellation  of  noise  in  speech  signals  such  as  the 
situation  which  arises  in  pilot  communications  with  a high  level  of  back- 
ground engine  noise.  This  interference  contains  strong  periodic  components 
in  the  speech  frequency  band  and  the  intelligibility  of  the  radio  trans- 
mission is  affected.  A conventional  filter  would  not  be  sufficient  since  th- 
frequency  and  intensity  of  these  interference  signals  vary  with  engine  sn> 
and  load,  in  addition  to  the  location  of  the  pilots  head.  Figure  41  F - 
•he  cancellation  of  noise  in  this  particular  example.  A refeten  • 

obtained  by  placing  a second  microphone  at  a suitable  lo  i'i. 

, , , ,86 

cabin.  i.xperiments  have  been  performed  to  illustr,.*- 
cancellation  with  st  rong  acous' ial  interference  in  *p<  . 
interference  consisted  of  an  audio  frequency  'ria-  uU 

^ IF  Widrow.  et.  at.,  "Adaptive  'oi  — 

Pro.  . IhKK  63  . 16‘»Z  1 1 9 7 c . 
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i-  u;art  41.  Cancellation  ot’  Noise  in  Speech  Communication 

many  harmonics  which  varied  in  amplitude  and  phase  because  of  the 
multipath  scarerim:  effects  throughout  the  room.  Typically,  16  analog 

weights  rendored  the  interference  barely  perceptible  to  the  remote 

..  ,,86 

1 1 stene  r . 

A third  area  of  noise  cancelling  is  in  adaptive  cancellation  of  sidelobe 
interference  in  receiving  arrays.  For  example,  a sensor  beamformer  may 
be  constrained  with  the  adaptive  noise  canceller  as  shown  in  figure  42.  The 
multiple  reference  inputs  to  the  noise  canceller  are  obtained  from  the 
deloged  beam  former  element  outputs  prior  to  summation.  The  operation 
of  the  beamformer  is  constrained  by  the  selection  of  the  weighting  coefficients 
of  the  adaptive  filter  taps.  The  gains  of  the  control  taps  in  the  adaptive 

87 

B.  Widrow  and  J.  M.  McCool,  "A  Comparison  of  Adaptive  Algorithms  based 
on  the  Methods  of  Steepest  Descent  and  Random  Search"  IEEE  Trans.  Anten. 
and  Prop.,  AP-24.  615  (1976). 


CONVENTIONAL  BEAMFORMER  ADAPTIVE  NOISE  CANCELLER 


Figure  42.  A Null-Constrained  Adaptive  Beamforme  r ^Array- 
Tolerant  Array  Element  Gain  and  Phase  Errors 

filter  are  constrained  to  zero  in  some  manner  so  as  to  provide  compensation 
for  variations  in  element  gain  and  phase  and  to  permit  the  reception  of  broad- 
band signals  over  a desired  angular  sector. 

A fourth  area  of  interest  is  the  separation  of  broadband  and  periodic 
signals  as  illustrated  in  figure  43.  The  insertion  of  a fixed  delay  in  two 
reference  path,  as  shown  in  figure  43a,  decorrelates  the  broadband  com- 
ponents will  remain  correlated  with  each  other.  This  is  an  excellent  method 
in  the  case  when  no  external  reference  input  is  available  such  as  speech  or 
music  playback  in  the  presence  of  tape  hum  or  turntable  rumble.  Another 
area  of  application  is  in  spread-spectrum  comm  tication  with  narrow -band 
jamming.  Figure  43b  illustrates  the  recovery  of  the  periodic  components  and 
application  such  as  automatic  signal  seeking  and  the  enhancement  of  low 
level  sinusoidal  signals  buried  in  broadband  noise.  Thus,  the  adaptive  filter 
functions  as  a coherent  signal  processor. 
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b)  Self-Tuned  Filter 

Figure  43.  Separation  of  Broadband  and  Peripdic  Signals 
as  in  Spread  Spectrum  Systems 


I 
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7.  2 ADAPTIVE  LIN  EAR  PREDICTION  FOR  NARROWBAND  SPEECH 
VOICE  PROCESSING 

A promising  area  for  CCD  adaptive  filtering  is  in  speech  processing  where 
redundancy  in  the  spoken  word  has  long  been  recognized  by  researchers. 
Electrical  processing  of  speech  which  takes  into  account  this  redundancy 
can  be  used  to  substantially  reduce  the  bandwidth  required  for  speech 
transmission.  For  example,  if  speech  is  sampled  and  quantized  at  56  k bits  sec 
|7  bits  or  128  possible  amplitude  levels  per  sample  at  8 k samples/sec) 
for  acceptable  fidelity  and  the  channel  bandwidth  restricts  transmission  to 
below  4 k bits  sec,  then  a speech  compression  ratio  of  approximately 
15:1  is  attempted.  This  low  data  rate  would  permit  speech  to  be  transmitted 
over  high  frequency  radio  or  telephone  links  which  have  bandwidths  barely 
v.  ide  enough  for  the  original  analog  speech  sounds.  Such  a narrow-band 
voice  digitizer  may  be  used  in  frequency  division  multiplexing  for  simul- 
taneous transmission  over  wide-band  channels.  Narrow-band  digitized 
speech  lends  itself  to  encryption  for  secure  communications  and  provides 
a better  S N then  a wide-band  digitizer  particularly  in  RF  transmission 
communication  sattelite  links  with  limited  or  fixed  available  power. 

'Speech  compression,  which  maintains  intelligibility,  nas  always  been 

difficult  because  speech  consists  of  more  than  words  and  messages.  Speech 

has  the  vocal  timbre  and  conversational  idiosync  rosies  of  the  speaker  and 

the  emotion  behind  his  words.  It  is  normally  constructed  in  an  imprompt 

manner  and  delivered  in  a free  and  informal  fashion.  Speech  flows  in  time 

as  a continuation  that  a voice  digitizer  must  process  in  real  time,  leaving 

no  chance  for  later  evaluation  or  correction.  Although  the  information 

content  of  the  message  itself  may  be  low,  (possibly'  below  100  bits/sec), 

transmission  of  the  subtle  vocal  inflections  requires  a date  rate  of  several 

88 

thousand  bits' sec.  " Historically,  speech  compression  and  reconstruction 
88 

G.  S.  Kang,  "Linear  Productive  Narrowband  Voice  Digitizer"  KASCON  74, 

51,  Washington,  D.  C.  Oct.  7-9,  1974 


began  with  the  Dudley  channel  vocoder  in  1936  in  which  the  Fourier 

Spectrum  characteristics  of  speech  determined  the  parameters  of  a filter 

bank.  This  vocal  tract  filter  bank  approximated  the  vocal  tract  resonance 

characteristics  of  speech  and  it  was  excited  by  a pulse  generator  (variable 

period)  to  approximate  the  vowels  or  larynx  vibration  and  a random  noise 

generator  to  represent  the  consonants  or  fricative  nasal  sounds. 

Another  technique  has  proven  quite  successful  in  speech  compression: 

89 

linear  predictive  analysis.  The  Fourier  analysis  method  treats  the  past 
signal,  and  the  linear  predictive  analysis  method  attempts  to  predict  the 
future  signal.  Linear  prediction  uses  time  domain  characteristics  of  the 
speech  signal  and  the  voice  signal  is  analyzed  as  a linear  combination  of 
present  and  past  values  to  form  a set  of  prediction  coefficients.  Lf  10  to  12 
consecutive  samples  of  speech  are  taken  (i.  e.  a speech  segment  of  1.  25  to 

1.  5 milliseconds),  then  prediction  coefficients  can  be  generated  as  the  tap 
weights  in  an  adaptive  filter.  Although  only  10  to  12  prediction  coefficients 
are  needed,  one  must  accumulate  many  speech  samples  (e.  g.  100  to  200 
samples)  to  determine  these  coefficients  with  some  degree  of  accuracy. 

The  accuracy  of  these  measurements  was  discussed  by  Gauss  (see  section 

2.  0)  with  regards  to  highly  redundant  or  over-determined  equations  and  he 
formulated  the  method  of  lea s t- squa res.  This  method  is  used  in  the  CCD 
adaptive  filter. 

Figure  44  illustrates  a functional  diagram  of  a conventional  digital  linear 
productive  narrowband  voice  processor.  The  major  functional  elements  of 
this  system  are 

• vocal  tract  analyzer  • encoder  decoder 

• pitch  extractor 

• voice /unvoice  analyzer 

• synthesizer 

89  ” 

B.  S.  Atal  and  S.  L.  Hanauer.  "Speech  Analysis  and  Synthesis  by  Linear 
Prediction  of  the  Speech  Wave",  J.  of  Acoust.  Soc.  Amer.  , 5C),  637  (1971). 
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Figure  44.  Narrowband  Voice  System 


Digital  systems  which  use  linear  prediction  have  been  analyzed  and  built, 
however,  the  major  limitations  to  an  all  digital  approach  are  size,  power 
dissipation,  and  cost.  Table  4 illustrates  a comparison  between  the  digital, 
hybrid,  and  discrete  analog  sampled  approaches  for  a narrowband  voice 
system. 

Figure  45  and  46  illustrates  the  use  of  the  CCD  Adaptive  filter  as  an 

Analysis  filter  to  generate  the  prediction  coefficients  VV  * * * W . The 

I N 

voice  input  is  band-pass  filtered  and  inputted  to  the  adaptive  filter.  The 
filter  input  is  also  used  as  the  primary  or  desired  signal  to  generate  an 
error  called  the  prediction  residual.  This  error  may  be  further  messaged 


90-91 


J.  E.  Dunn,  J,  R.  Lowan  and  A.  J.  Russo,  "Progress  in  The  Development  of 
a Digital  Vocoder  Employing  on  Itakura  Adaptive  Predictor"  (1973) 

* Final  Report,  Voice  Processor  1 ,St/Q r ga nizat ion  Optimitation  Study,  Contract 
No.  I )CA  100-75-C-0020,  Sept.  1975  TRW  Systems  Croup,  Redundo  Reach,  Cal. 


7-8 


-J 


TABLE  4. 


NARROWBAND  VOICE  DIGITIZER 


f>  of 
I.  C. 

's  Power 

Size 

Prod. 

Cost 

Risk 

Digital 

125 

50w 

3"x5"xI2" 

10k 

Low 

Hybrid 

40 

- 

3"x5"x6" 

- 

Med 

DASP 

12 

7w 

1 "x5"x5" 

0.  5-lk 

High 

iL 
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Figure  46.  CCD  Adaptive  Prediction 


to  extract  the  pitch  period,  amplitude,  and  voice  ' unvoice  decision.  I he 

speech  sample  may  be  nominally20  msec  in  length  and  the  error  must 

converge  to  its  minimum  value  in  this  time  frame.  Near  the  end  of  the  time 

frame,  a unit  pulse  in  inserted  into  the  filter  and  the  filler  output  becomes 

the  converged  weights  or  prediction  coefficients.  The  clipped  data  LMS 

92 

algorithm  has  been  computer  simulated  at  NRL  with  the  following  constraints, 

• preemphasis  filter  on  the  input  signal 

• W,  0.  98 

k 

• an  increase  of  the  unit  circle  (/.-domain)  by  10  percent  with 
scaling  of  the  prediction  coefficients 

• 10  prediction  coefficients  of  bit  levels:  8,  8,  8,  8,  7,  7,  7,  6,  5,  5 

• data  rate  of  3600  bits  sec. 

. ne  prediction  coefficients  genera'ed  with  the  clipped  date  LMS  algorithm 

and  the  above  constraints  were  used  to  synthesize  speech.  Test  sentences 

were  employed  and  the  playback  of  the  reconstructed  speech  indicated  good 

speech  reproduction  and  quality,  although  the  latter  is  a subjective  parameter. 

Ihus.  a CCD  adaptive  filter  with  10  weights  operating  at  a 8 kHz  sample  rate 

would  be  an  excellent  candidate  for  this  particular  application. 

7.  3 ADAPTIVE  ECHO  CANCELLATION  FILTERS 

An  important  application  of  CCD  adaptive  transversal  filters  is  in  echo 

, 93 

cancella  ion  in  the  telephone  network.  Weinstein  says,  "It  is,  to  be 

honest,  remarkable  that  a technique  (echo  cancellation)  which  has  been 
studied,  favorably  appraised,  and  implemented  in  experimental  hardware 
for  more  than  10  years  has  still  not  been  commercially  applied.  The  obvious 
reason  is  that  echo  cancellers  which  performs  better  than  echo  suppressors 
have  tended  to  cost  much  mo^e  than  echo  suppressors,  it  is  intrinsically 


C.  S.  Kang,  Private  Communication,  Naval  Research  l aboratories  (1977) 

S.  B.  Weinstein,  "Echo  Cancellation  in  the  Telephone  Network",  IEEE 
Communications  Society  Magazine  , pg.  9.  Jan.  1977. 
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more  difficult  to  discover  and  separate  an  echo  from  a mixture  of  signals 
than  to  block  everything.  " CCD  adaptive  filters  offer  a means  to  realize 
such  an  echo  canceller. 

1 he  study  of  echos  in  the  telephone  network  has  shown  that  it  is  difficult 
to  conduct  a conversation  when  a person's  voice  returns  with  a delay 
greater  than  a few  'ens  of  milliseconds.  The  long-delayed  echos  are  irritating 
anti  returns  attenuated  -40  dR  below  the  speakers  voice  level  will  cause  the 
speaker  problems.  Echos  occur  due  to  impedance  mismatches  in  the  com- 
munication system  as  illustrated  in  figure  47a,  which  describes  signal 
leakage  and  reflection  at  the  hybrid  coupler,  figure  47b  illustrates  how  an 
echo  canceller  is  used  to  model  the  echo  channel  and  generate  an  output  echo 
replica  ’o  cancel  the  echo.  this  is  particularly  important  in  satellite- 
routed  circuits  which  experience  signal  delays  in  excess  of  500  msec. 
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a)  Model  of  Long-Distance 

lelephone  Circuit  Which  May 
Include  a Satellite  Link 


b)  Echo  Cancellation  with  CCD 
Adaptive  Filter  to  Model 
Echo  Channel  from  Points  A to  B 


Figure  47.  Echo  Cancellation  with  CCD  Adaptive  Filters 
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8.  CONCLUSIONS 


We  have  demonstrated  the  feasibility  of  CCD  Adaptive  Discrete  Analog 
Signal  Processing  with  the  implementation  of  a breadboard,  2-tap  weight, 
adaptive  filter  based  on  the  "clipped-data"  LMS  recursive  algorithm  of 
Professor  B.  Widrow  and  associates  at  Stanford  Univer  lty.  The  bread- 
board consists  of  components  which  may  be  integrated  • n a single  monolithic 
silicon  integrated  circuit.  For  example,  the  basic  linear  combiner  is  a 
monolithic  CCD-SI  PO  transversal  filter  with  MOS/bipolar  circuitry  at 
each  tap  position,  and  the  adjustable  weights  are  electrically  reprogrammabl 
MNOS  analog  conductances  whose  technology  is  compatible  with  CCD 
technologv.  The  recursive  algorithm  is  constructed  with  steering  networks, 
exclusive  ORs,  and  digital  shift  register  which  can  be  implemented  in 
standard  MOS  technology.  Thus,  the  basic  linear  combiner  and  recursive 
LMS  algorithm  may  be  integrated  on  a single  silicon  chip  to  represent 
the  first  step  in  the  direction  of  integrated  circuit  discrete  analog  adaptive 
signal  processing. 

The  performance  of  the  CCD  adaptive  filter  demonstrated  the  operation 
of  the  LMS  algorithm  in  adaptive  signal  p-ocessing.  An  adaptive  noise 
canceller  was  evaluated  which  provided  excellent  rejection  (-35  dB)  of  an 
interfering  signal  with  tolerance  for  phase-shift  difference  between  desired 
and  reference  inputs  to  the  filter  (±3  dB  for  ±1805).  Adjustments  are 
required  for  the  clear/write  (10  - 20V  operation)  and  read  (5  - 10V  opera- 
tion) voltages  to  optimize  the  programmability  (update  mode)  and  measure- 
ment (read  mode)  operations  for  the  adaptive  filter.  The  "clipped-data" 

LMS  algorithm  offers  distinct  advantages  over  the  linear  LMS  algorithm 
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sine*:  iti*  former  has  a convergence  t ime -constant  inversely  proportional 
to  reference  input  amplitude  and  notch-filter  bandwidth  proportional  to 
reference  input  amplitude,  while  the  latter  is  a function  of  reference  input 
power  level.  In  addition,  the  hardware  requirements  are  greatly  simplified 
due  o the  elimination  of  a 4-quadrant  analog  multiplier.  We  have  varied  the 
reference  input  signal  amplitude  bv  20  dB  relative  to  the  desired  (primary) 
signal  amplitude  and  maintained  better  than  -20  dB  rejection. 

The  advantages  of  CCD  discrete  analog  adaptive  signal  processing  lie  in 
the  ability  of  IC  technology  to  provide  a compact,  low-power,  low-cost, 
signal  processor  capable  of  performing  real-time  adaptive  filtering.  The 
terminology  filter  is  quite  broad,  and  the  actual  applications  of  this 
technology  extend  into  prediction  or  estimation,  spectral  analysis  based  on 
maximum  entropy  considerations,  system  modeling,  etc.  I he  adaptive 
signal  processor  IC  is  analogous  to  the  microprocessor  IC  in  terms  of 
evolutionary  development  with  the  added  advantage  of  being  a learning 
machine  which  measures  the  statistical  characteristics  of  the  signal 
inputs  and  applies  these  measurements  to  internally  adjust  parameters  for 
optimization  of  specified  system  parameters.  Once  the  CCD  adaptive 
signal  processor  (with  10  - 32  taps)  is  constructed  on  an  integrated 
circuit,  there  will  be  many  areas  of  application  such  as  speech  processing, 
noise  cancellation  in  medical  and  communication/control  systems,  spectral 
analysis,  echo-cancellation,  etc. 

Although  adaptive  filtering  has  been  the  subject  of  many  papers,  con- 
ferences, and  lectures  over  the  past  two  decades,  the  basic  limitation 
to  the  use  of  this  exciting  subject  has  been  the  cost  in  hardware  construction, 
the  site  of  t he  actual  hardware,  and  the  power  consumption  requirements. 

As  a result  of  these  limitations,  adaptive  filtering  and  signal  processing  has 
been  restricted  • n usage.  With  the  advent  of  an  IC  adaptive  signal  processor 
chip,  a variety  of  applicable  areas  can  be  opened  to  the  potential  user. 
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